2023-10-30 21:53:11,764 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-10-30 21:53:12,019 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40 2023-10-30 21:53:12,032 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-30 21:53:12,032 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/cluster_28bfcc88-fd43-a1ce-833d-58e2af823f6c, deleteOnExit=true 2023-10-30 21:53:12,033 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-30 21:53:12,033 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/test.cache.data in system properties and HBase conf 2023-10-30 21:53:12,034 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/hadoop.tmp.dir in system properties and HBase conf 2023-10-30 21:53:12,034 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/hadoop.log.dir in system properties and HBase conf 2023-10-30 21:53:12,034 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-30 21:53:12,035 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-30 21:53:12,035 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-30 21:53:12,154 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-30 21:53:12,576 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-30 21:53:12,582 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-30 21:53:12,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-30 21:53:12,584 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-30 21:53:12,584 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-30 21:53:12,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-30 21:53:12,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-30 21:53:12,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-30 21:53:12,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-30 21:53:12,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-30 21:53:12,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/nfs.dump.dir in system properties and HBase conf 2023-10-30 21:53:12,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/java.io.tmpdir in system properties and HBase conf 2023-10-30 21:53:12,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-30 21:53:12,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-30 21:53:12,588 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-30 21:53:13,256 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-30 21:53:13,261 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-30 21:53:13,576 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-30 21:53:13,746 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-30 21:53:13,763 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-30 21:53:13,804 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-30 21:53:13,839 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/java.io.tmpdir/Jetty_localhost_40833_hdfs____.8hsjay/webapp 2023-10-30 21:53:13,987 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40833 2023-10-30 21:53:13,997 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-30 21:53:13,997 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-30 21:53:14,567 WARN [Listener at localhost/42305] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-30 21:53:14,659 WARN [Listener at localhost/42305] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-30 21:53:14,685 WARN [Listener at localhost/42305] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-30 21:53:14,694 INFO [Listener at localhost/42305] log.Slf4jLog(67): jetty-6.1.26 2023-10-30 21:53:14,701 INFO [Listener at localhost/42305] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/java.io.tmpdir/Jetty_localhost_40675_datanode____8wuy67/webapp 2023-10-30 21:53:14,815 INFO [Listener at localhost/42305] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40675 2023-10-30 21:53:15,214 WARN [Listener at localhost/36139] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-30 21:53:15,755 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x48055287133b7cb9: Processing first storage report for DS-8d877443-4c2c-4506-9832-2003f3d163ee from datanode ac4e3709-2f37-4845-b3a9-02be2e5644e6 2023-10-30 21:53:15,757 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x48055287133b7cb9: from storage DS-8d877443-4c2c-4506-9832-2003f3d163ee node DatanodeRegistration(127.0.0.1:41231, datanodeUuid=ac4e3709-2f37-4845-b3a9-02be2e5644e6, infoPort=41743, infoSecurePort=0, ipcPort=36139, storageInfo=lv=-57;cid=testClusterID;nsid=1146135194;c=1698702793341), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-30 21:53:15,757 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x48055287133b7cb9: Processing first storage report for DS-bf848c23-cf38-4187-af6f-852e6e7d599c from datanode ac4e3709-2f37-4845-b3a9-02be2e5644e6 2023-10-30 21:53:15,757 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x48055287133b7cb9: from storage DS-bf848c23-cf38-4187-af6f-852e6e7d599c node DatanodeRegistration(127.0.0.1:41231, datanodeUuid=ac4e3709-2f37-4845-b3a9-02be2e5644e6, infoPort=41743, infoSecurePort=0, ipcPort=36139, storageInfo=lv=-57;cid=testClusterID;nsid=1146135194;c=1698702793341), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-30 21:53:15,845 DEBUG [Listener at localhost/36139] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40 2023-10-30 21:53:15,928 INFO [Listener at localhost/36139] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/cluster_28bfcc88-fd43-a1ce-833d-58e2af823f6c/zookeeper_0, clientPort=56981, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/cluster_28bfcc88-fd43-a1ce-833d-58e2af823f6c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/cluster_28bfcc88-fd43-a1ce-833d-58e2af823f6c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-30 21:53:15,946 INFO [Listener at localhost/36139] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56981 2023-10-30 21:53:15,957 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 21:53:15,960 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 21:53:16,653 INFO [Listener at localhost/36139] util.FSUtils(471): Created version file at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44 with version=8 2023-10-30 21:53:16,653 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/hbase-staging 2023-10-30 21:53:16,963 INFO [Listener at localhost/36139] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-30 21:53:17,435 INFO [Listener at localhost/36139] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-10-30 21:53:17,467 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 21:53:17,467 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-30 21:53:17,468 INFO [Listener at localhost/36139] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-30 21:53:17,468 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 21:53:17,468 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-30 21:53:17,615 INFO [Listener at localhost/36139] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-30 21:53:17,701 DEBUG [Listener at localhost/36139] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-30 21:53:17,794 INFO [Listener at localhost/36139] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33927 2023-10-30 21:53:17,804 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 21:53:17,806 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 21:53:17,834 INFO [Listener at localhost/36139] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33927 connecting to ZooKeeper ensemble=127.0.0.1:56981 2023-10-30 21:53:17,883 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:339270x0, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-30 21:53:17,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33927-0x1019952dc2b0000 connected 2023-10-30 21:53:17,911 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-30 21:53:17,911 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 21:53:17,919 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-30 21:53:17,932 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33927 2023-10-30 21:53:17,933 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33927 2023-10-30 21:53:17,933 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33927 2023-10-30 21:53:17,937 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33927 2023-10-30 21:53:17,937 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33927 2023-10-30 21:53:17,943 INFO [Listener at localhost/36139] master.HMaster(444): hbase.rootdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44, hbase.cluster.distributed=false 2023-10-30 21:53:18,020 INFO [Listener at localhost/36139] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-10-30 21:53:18,020 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 21:53:18,021 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-30 21:53:18,021 INFO [Listener at localhost/36139] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-30 21:53:18,021 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-30 21:53:18,021 INFO [Listener at localhost/36139] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-30 21:53:18,028 INFO [Listener at localhost/36139] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-30 21:53:18,033 INFO [Listener at localhost/36139] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44371 2023-10-30 21:53:18,036 INFO [Listener at localhost/36139] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-30 21:53:18,045 DEBUG [Listener at localhost/36139] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-10-30 21:53:18,045 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 21:53:18,048 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 21:53:18,050 INFO [Listener at localhost/36139] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44371 connecting to ZooKeeper ensemble=127.0.0.1:56981 2023-10-30 21:53:18,054 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:443710x0, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-30 21:53:18,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44371-0x1019952dc2b0001 connected 2023-10-30 21:53:18,055 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-30 21:53:18,056 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 21:53:18,057 DEBUG [Listener at localhost/36139] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-30 21:53:18,058 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44371 2023-10-30 21:53:18,058 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44371 2023-10-30 21:53:18,059 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44371 2023-10-30 21:53:18,059 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44371 2023-10-30 21:53:18,060 DEBUG [Listener at localhost/36139] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44371 2023-10-30 21:53:18,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33927,1698702796803 2023-10-30 21:53:18,074 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-30 21:53:18,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33927,1698702796803 2023-10-30 21:53:18,103 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-30 21:53:18,103 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-30 21:53:18,103 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 21:53:18,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-30 21:53:18,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33927,1698702796803 from backup master directory 2023-10-30 21:53:18,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-30 21:53:18,108 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33927,1698702796803 2023-10-30 21:53:18,108 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-30 21:53:18,109 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-30 21:53:18,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33927,1698702796803 2023-10-30 21:53:18,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-30 21:53:18,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-30 21:53:18,601 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/hbase.id with ID: 882ce091-1e72-49f6-9e69-b76050d5ed9a 2023-10-30 21:53:18,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 21:53:18,660 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 21:53:19,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x16dfcc52 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:53:19,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e365145, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:53:19,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-30 21:53:19,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-30 21:53:19,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-30 21:53:19,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-30 21:53:19,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-30 21:53:19,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-30 21:53:19,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-30 21:53:19,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/data/master/store-tmp 2023-10-30 21:53:19,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:19,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-30 21:53:19,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 21:53:19,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 21:53:19,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-30 21:53:19,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 21:53:19,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 21:53:19,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-30 21:53:19,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/WALs/jenkins-hbase4.apache.org,33927,1698702796803 2023-10-30 21:53:19,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33927%2C1698702796803, suffix=, logDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/WALs/jenkins-hbase4.apache.org,33927,1698702796803, archiveDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/oldWALs, maxLogs=10 2023-10-30 21:53:19,761 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41231,DS-8d877443-4c2c-4506-9832-2003f3d163ee,DISK] 2023-10-30 21:53:19,774 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-30 21:53:19,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/WALs/jenkins-hbase4.apache.org,33927,1698702796803/jenkins-hbase4.apache.org%2C33927%2C1698702796803.1698702799701 2023-10-30 21:53:19,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41231,DS-8d877443-4c2c-4506-9832-2003f3d163ee,DISK]] 2023-10-30 21:53:19,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:53:19,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:19,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-30 21:53:19,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-30 21:53:19,951 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-30 21:53:19,959 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-30 21:53:19,986 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-30 21:53:20,001 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:20,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-30 21:53:20,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-30 21:53:20,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-30 21:53:20,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:53:20,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74735365, jitterRate=0.11364372074604034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:53:20,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-30 21:53:20,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-30 21:53:20,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-30 21:53:20,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-30 21:53:20,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-30 21:53:20,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-30 21:53:20,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 40 msec 2023-10-30 21:53:20,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-30 21:53:20,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-30 21:53:20,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-30 21:53:20,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-30 21:53:20,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-30 21:53:20,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-30 21:53:20,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-30 21:53:20,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-30 21:53:20,187 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 21:53:20,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-30 21:53:20,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-30 21:53:20,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-30 21:53:20,212 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-30 21:53:20,212 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-30 21:53:20,212 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 21:53:20,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33927,1698702796803, sessionid=0x1019952dc2b0000, setting cluster-up flag (Was=false) 2023-10-30 21:53:20,231 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 21:53:20,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-30 21:53:20,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33927,1698702796803 2023-10-30 21:53:20,252 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 21:53:20,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-30 21:53:20,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33927,1698702796803 2023-10-30 21:53:20,262 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp 2023-10-30 21:53:20,266 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(951): ClusterId : 882ce091-1e72-49f6-9e69-b76050d5ed9a 2023-10-30 21:53:20,271 DEBUG [RS:0;jenkins-hbase4:44371] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-30 21:53:20,279 DEBUG [RS:0;jenkins-hbase4:44371] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-30 21:53:20,279 DEBUG [RS:0;jenkins-hbase4:44371] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-30 21:53:20,284 DEBUG [RS:0;jenkins-hbase4:44371] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-30 21:53:20,293 DEBUG [RS:0;jenkins-hbase4:44371] zookeeper.ReadOnlyZKClient(139): Connect 0x29978007 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:53:20,303 DEBUG [RS:0;jenkins-hbase4:44371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27506b45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:53:20,304 DEBUG [RS:0;jenkins-hbase4:44371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@236feb77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-30 21:53:20,330 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44371 2023-10-30 21:53:20,334 INFO [RS:0;jenkins-hbase4:44371] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-30 21:53:20,334 INFO [RS:0;jenkins-hbase4:44371] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-30 21:53:20,334 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1022): About to register with Master. 2023-10-30 21:53:20,337 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33927,1698702796803 with isa=jenkins-hbase4.apache.org/172.31.14.131:44371, startcode=1698702798019 2023-10-30 21:53:20,355 DEBUG [RS:0;jenkins-hbase4:44371] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-30 21:53:20,432 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58887, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-30 21:53:20,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-30 21:53:20,440 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33927] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-30 21:53:20,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-30 21:53:20,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-30 21:53:20,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-30 21:53:20,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-30 21:53:20,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-30 21:53:20,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-30 21:53:20,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1698702830457 2023-10-30 21:53:20,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-30 21:53:20,464 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-30 21:53:20,464 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-30 21:53:20,470 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-30 21:53:20,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-30 21:53:20,473 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(2830): Master is not running yet 2023-10-30 21:53:20,473 WARN [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-30 21:53:20,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-30 21:53:20,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-30 21:53:20,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-30 21:53:20,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-30 21:53:20,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:20,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-30 21:53:20,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-30 21:53:20,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-30 21:53:20,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-30 21:53:20,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-30 21:53:20,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1698702800488,5,FailOnTimeoutGroup] 2023-10-30 21:53:20,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1698702800488,5,FailOnTimeoutGroup] 2023-10-30 21:53:20,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:20,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-30 21:53:20,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:20,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:20,574 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33927,1698702796803 with isa=jenkins-hbase4.apache.org/172.31.14.131:44371, startcode=1698702798019 2023-10-30 21:53:20,581 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33927] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:20,587 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44 2023-10-30 21:53:20,587 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42305 2023-10-30 21:53:20,587 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-30 21:53:20,593 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-30 21:53:20,593 DEBUG [RS:0;jenkins-hbase4:44371] zookeeper.ZKUtil(162): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:20,594 WARN [RS:0;jenkins-hbase4:44371] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-30 21:53:20,594 INFO [RS:0;jenkins-hbase4:44371] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-30 21:53:20,595 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/WALs/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:20,596 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44371,1698702798019] 2023-10-30 21:53:20,607 DEBUG [RS:0;jenkins-hbase4:44371] zookeeper.ZKUtil(162): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:20,618 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-30 21:53:20,628 INFO [RS:0;jenkins-hbase4:44371] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-30 21:53:20,652 INFO [RS:0;jenkins-hbase4:44371] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-30 21:53:20,656 INFO [RS:0;jenkins-hbase4:44371] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:53:20,656 INFO [RS:0;jenkins-hbase4:44371] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:20,658 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-30 21:53:20,665 INFO [RS:0;jenkins-hbase4:44371] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-10-30 21:53:20,666 DEBUG [RS:0;jenkins-hbase4:44371] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,666 DEBUG [RS:0;jenkins-hbase4:44371] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,666 DEBUG [RS:0;jenkins-hbase4:44371] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,667 DEBUG [RS:0;jenkins-hbase4:44371] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,667 DEBUG [RS:0;jenkins-hbase4:44371] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,667 DEBUG [RS:0;jenkins-hbase4:44371] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-30 21:53:20,667 DEBUG [RS:0;jenkins-hbase4:44371] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,667 DEBUG [RS:0;jenkins-hbase4:44371] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,667 DEBUG [RS:0;jenkins-hbase4:44371] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,668 DEBUG [RS:0;jenkins-hbase4:44371] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-30 21:53:20,669 INFO [RS:0;jenkins-hbase4:44371] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:20,669 INFO [RS:0;jenkins-hbase4:44371] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:20,669 INFO [RS:0;jenkins-hbase4:44371] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:20,686 INFO [RS:0;jenkins-hbase4:44371] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-30 21:53:20,688 INFO [RS:0;jenkins-hbase4:44371] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44371,1698702798019-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:20,710 INFO [RS:0;jenkins-hbase4:44371] regionserver.Replication(203): jenkins-hbase4.apache.org,44371,1698702798019 started 2023-10-30 21:53:20,710 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44371,1698702798019, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44371, sessionid=0x1019952dc2b0001 2023-10-30 21:53:20,711 DEBUG [RS:0;jenkins-hbase4:44371] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-30 21:53:20,711 DEBUG [RS:0;jenkins-hbase4:44371] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:20,711 DEBUG [RS:0;jenkins-hbase4:44371] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44371,1698702798019' 2023-10-30 21:53:20,711 DEBUG [RS:0;jenkins-hbase4:44371] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:20,712 DEBUG [RS:0;jenkins-hbase4:44371] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:20,712 DEBUG [RS:0;jenkins-hbase4:44371] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-30 21:53:20,713 DEBUG [RS:0;jenkins-hbase4:44371] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-30 21:53:20,713 DEBUG [RS:0;jenkins-hbase4:44371] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:20,713 DEBUG [RS:0;jenkins-hbase4:44371] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44371,1698702798019' 2023-10-30 21:53:20,713 DEBUG [RS:0;jenkins-hbase4:44371] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-30 21:53:20,713 DEBUG [RS:0;jenkins-hbase4:44371] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-30 21:53:20,714 DEBUG [RS:0;jenkins-hbase4:44371] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-30 21:53:20,714 INFO [RS:0;jenkins-hbase4:44371] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-30 21:53:20,714 INFO [RS:0;jenkins-hbase4:44371] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-30 21:53:20,829 INFO [RS:0;jenkins-hbase4:44371] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44371%2C1698702798019, suffix=, logDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/WALs/jenkins-hbase4.apache.org,44371,1698702798019, archiveDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/oldWALs, maxLogs=32 2023-10-30 21:53:20,851 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41231,DS-8d877443-4c2c-4506-9832-2003f3d163ee,DISK] 2023-10-30 21:53:20,856 INFO [RS:0;jenkins-hbase4:44371] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/WALs/jenkins-hbase4.apache.org,44371,1698702798019/jenkins-hbase4.apache.org%2C44371%2C1698702798019.1698702800832 2023-10-30 21:53:20,856 DEBUG [RS:0;jenkins-hbase4:44371] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41231,DS-8d877443-4c2c-4506-9832-2003f3d163ee,DISK]] 2023-10-30 21:53:20,900 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-30 21:53:20,901 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-30 21:53:20,901 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44 2023-10-30 21:53:20,919 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:20,921 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-30 21:53:20,924 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/info 2023-10-30 21:53:20,925 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-30 21:53:20,927 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:20,927 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-30 21:53:20,930 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/rep_barrier 2023-10-30 21:53:20,931 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-30 21:53:20,931 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:20,932 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-30 21:53:20,934 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/table 2023-10-30 21:53:20,934 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-30 21:53:20,935 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:20,937 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740 2023-10-30 21:53:20,938 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740 2023-10-30 21:53:20,942 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-30 21:53:20,944 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-30 21:53:20,947 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:53:20,948 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65061998, jitterRate=-0.030500680208206177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-30 21:53:20,948 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-30 21:53:20,948 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-30 21:53:20,948 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-30 21:53:20,948 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-30 21:53:20,948 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-30 21:53:20,948 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-30 21:53:20,950 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-30 21:53:20,950 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-30 21:53:20,958 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-30 21:53:20,958 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-30 21:53:20,968 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-30 21:53:20,981 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-30 21:53:20,983 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-30 21:53:21,135 DEBUG [jenkins-hbase4:33927] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-10-30 21:53:21,139 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44371,1698702798019, state=OPENING 2023-10-30 21:53:21,149 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-30 21:53:21,151 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 21:53:21,151 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-30 21:53:21,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:53:21,336 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:21,338 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-30 21:53:21,341 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-30 21:53:21,352 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-30 21:53:21,353 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-30 21:53:21,356 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44371%2C1698702798019.meta, suffix=.meta, logDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/WALs/jenkins-hbase4.apache.org,44371,1698702798019, archiveDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/oldWALs, maxLogs=32 2023-10-30 21:53:21,374 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41231,DS-8d877443-4c2c-4506-9832-2003f3d163ee,DISK] 2023-10-30 21:53:21,378 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/WALs/jenkins-hbase4.apache.org,44371,1698702798019/jenkins-hbase4.apache.org%2C44371%2C1698702798019.meta.1698702801357.meta 2023-10-30 21:53:21,379 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41231,DS-8d877443-4c2c-4506-9832-2003f3d163ee,DISK]] 2023-10-30 21:53:21,379 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:53:21,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-30 21:53:21,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-30 21:53:21,403 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-30 21:53:21,408 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-30 21:53:21,408 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:21,408 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-30 21:53:21,408 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-30 21:53:21,412 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-30 21:53:21,413 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/info 2023-10-30 21:53:21,413 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/info 2023-10-30 21:53:21,414 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-30 21:53:21,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:21,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-30 21:53:21,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/rep_barrier 2023-10-30 21:53:21,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/rep_barrier 2023-10-30 21:53:21,417 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-30 21:53:21,418 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:21,418 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-30 21:53:21,420 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/table 2023-10-30 21:53:21,420 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/table 2023-10-30 21:53:21,420 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-30 21:53:21,421 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:21,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740 2023-10-30 21:53:21,425 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740 2023-10-30 21:53:21,429 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-30 21:53:21,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-30 21:53:21,432 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64567770, jitterRate=-0.037865251302719116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-30 21:53:21,432 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-30 21:53:21,441 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1698702801328 2023-10-30 21:53:21,457 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-30 21:53:21,458 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-30 21:53:21,459 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44371,1698702798019, state=OPEN 2023-10-30 21:53:21,462 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-30 21:53:21,462 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-30 21:53:21,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-30 21:53:21,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44371,1698702798019 in 308 msec 2023-10-30 21:53:21,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-30 21:53:21,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 499 msec 2023-10-30 21:53:21,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1500 sec 2023-10-30 21:53:21,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1698702801478, completionTime=-1 2023-10-30 21:53:21,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-10-30 21:53:21,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-10-30 21:53:21,546 DEBUG [hconnection-0x23e61a64-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:53:21,550 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:53:21,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-10-30 21:53:21,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1698702861566 2023-10-30 21:53:21,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1698702921566 2023-10-30 21:53:21,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 87 msec 2023-10-30 21:53:21,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33927,1698702796803-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:21,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33927,1698702796803-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:21,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33927,1698702796803-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:21,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33927, period=300000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:21,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-30 21:53:21,597 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-30 21:53:21,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-30 21:53:21,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-30 21:53:21,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-30 21:53:21,619 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:53:21,622 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:53:21,647 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0 2023-10-30 21:53:21,649 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0 empty. 2023-10-30 21:53:21,650 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0 2023-10-30 21:53:21,650 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-30 21:53:21,678 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-30 21:53:21,681 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5cafb98da3f570bc35e5e8c528f7fba0, NAME => 'hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:53:21,693 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:21,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5cafb98da3f570bc35e5e8c528f7fba0, disabling compactions & flushes 2023-10-30 21:53:21,694 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:53:21,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:53:21,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. after waiting 0 ms 2023-10-30 21:53:21,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:53:21,694 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:53:21,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5cafb98da3f570bc35e5e8c528f7fba0: 2023-10-30 21:53:21,699 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:53:21,714 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698702801702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702801702"}]},"ts":"1698702801702"} 2023-10-30 21:53:21,741 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 21:53:21,743 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:53:21,747 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702801743"}]},"ts":"1698702801743"} 2023-10-30 21:53:21,752 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-30 21:53:21,760 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5cafb98da3f570bc35e5e8c528f7fba0, ASSIGN}] 2023-10-30 21:53:21,763 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5cafb98da3f570bc35e5e8c528f7fba0, ASSIGN 2023-10-30 21:53:21,765 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5cafb98da3f570bc35e5e8c528f7fba0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:53:21,916 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5cafb98da3f570bc35e5e8c528f7fba0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:21,917 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698702801916"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702801916"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702801916"}]},"ts":"1698702801916"} 2023-10-30 21:53:21,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5cafb98da3f570bc35e5e8c528f7fba0, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:53:22,076 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:22,082 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:53:22,083 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5cafb98da3f570bc35e5e8c528f7fba0, NAME => 'hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:53:22,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5cafb98da3f570bc35e5e8c528f7fba0 2023-10-30 21:53:22,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:22,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5cafb98da3f570bc35e5e8c528f7fba0 2023-10-30 21:53:22,084 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5cafb98da3f570bc35e5e8c528f7fba0 2023-10-30 21:53:22,086 INFO [StoreOpener-5cafb98da3f570bc35e5e8c528f7fba0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5cafb98da3f570bc35e5e8c528f7fba0 2023-10-30 21:53:22,089 DEBUG [StoreOpener-5cafb98da3f570bc35e5e8c528f7fba0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0/info 2023-10-30 21:53:22,089 DEBUG [StoreOpener-5cafb98da3f570bc35e5e8c528f7fba0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0/info 2023-10-30 21:53:22,089 INFO [StoreOpener-5cafb98da3f570bc35e5e8c528f7fba0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cafb98da3f570bc35e5e8c528f7fba0 columnFamilyName info 2023-10-30 21:53:22,090 INFO [StoreOpener-5cafb98da3f570bc35e5e8c528f7fba0-1] regionserver.HStore(310): Store=5cafb98da3f570bc35e5e8c528f7fba0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:22,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0 2023-10-30 21:53:22,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0 2023-10-30 21:53:22,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5cafb98da3f570bc35e5e8c528f7fba0 2023-10-30 21:53:22,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:53:22,101 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5cafb98da3f570bc35e5e8c528f7fba0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70007482, jitterRate=0.043192774057388306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:53:22,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5cafb98da3f570bc35e5e8c528f7fba0: 2023-10-30 21:53:22,103 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0., pid=6, masterSystemTime=1698702802076 2023-10-30 21:53:22,107 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:53:22,107 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:53:22,109 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5cafb98da3f570bc35e5e8c528f7fba0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:22,109 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698702802108"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702802108"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702802108"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702802108"}]},"ts":"1698702802108"} 2023-10-30 21:53:22,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-30 21:53:22,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5cafb98da3f570bc35e5e8c528f7fba0, server=jenkins-hbase4.apache.org,44371,1698702798019 in 191 msec 2023-10-30 21:53:22,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-30 21:53:22,120 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5cafb98da3f570bc35e5e8c528f7fba0, ASSIGN in 356 msec 2023-10-30 21:53:22,121 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:53:22,121 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702802121"}]},"ts":"1698702802121"} 2023-10-30 21:53:22,124 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-30 21:53:22,129 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:53:22,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-30 21:53:22,131 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-30 21:53:22,131 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 21:53:22,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 522 msec 2023-10-30 21:53:22,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-30 21:53:22,177 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-30 21:53:22,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 26 msec 2023-10-30 21:53:22,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-30 21:53:22,198 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-30 21:53:22,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-10-30 21:53:22,212 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-30 21:53:22,215 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-30 21:53:22,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.107sec 2023-10-30 21:53:22,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-30 21:53:22,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-30 21:53:22,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-30 21:53:22,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33927,1698702796803-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-30 21:53:22,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33927,1698702796803-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-30 21:53:22,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-30 21:53:22,273 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(139): Connect 0x224c80d2 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:53:22,278 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b3da97a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:53:22,290 DEBUG [hconnection-0x2bb945d5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:53:22,305 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:53:22,315 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33927,1698702796803 2023-10-30 21:53:22,317 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(139): Connect 0x576037b1 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:53:22,321 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1673c80f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:53:22,321 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 21:53:22,346 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=318, ProcessCount=169, AvailableMemoryMB=15370 2023-10-30 21:53:22,357 DEBUG [Listener at localhost/36139] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:53:22,362 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:53:22,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 21:53:22,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:22,381 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:53:22,383 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:53:22,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-10-30 21:53:22,388 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:22,389 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da empty. 2023-10-30 21:53:22,391 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:22,391 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-10-30 21:53:22,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 21:53:22,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 21:53:22,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 21:53:22,817 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-30 21:53:22,820 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 29b75b5a035966f9b7d1aa40c20581da, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:53:23,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 21:53:23,237 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:23,237 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 29b75b5a035966f9b7d1aa40c20581da, disabling compactions & flushes 2023-10-30 21:53:23,237 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:23,237 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:23,238 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. after waiting 0 ms 2023-10-30 21:53:23,238 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:23,238 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:23,238 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:23,242 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:53:23,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698702803243"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702803243"}]},"ts":"1698702803243"} 2023-10-30 21:53:23,246 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 21:53:23,248 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:53:23,248 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702803248"}]},"ts":"1698702803248"} 2023-10-30 21:53:23,250 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-10-30 21:53:23,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=29b75b5a035966f9b7d1aa40c20581da, ASSIGN}] 2023-10-30 21:53:23,257 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=29b75b5a035966f9b7d1aa40c20581da, ASSIGN 2023-10-30 21:53:23,258 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=29b75b5a035966f9b7d1aa40c20581da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:53:23,410 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=29b75b5a035966f9b7d1aa40c20581da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:23,410 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698702803410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702803410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702803410"}]},"ts":"1698702803410"} 2023-10-30 21:53:23,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 29b75b5a035966f9b7d1aa40c20581da, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:53:23,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 21:53:23,567 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:23,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:23,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 29b75b5a035966f9b7d1aa40c20581da, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:53:23,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:23,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:23,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:23,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:23,577 INFO [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:23,579 DEBUG [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1 2023-10-30 21:53:23,579 DEBUG [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1 2023-10-30 21:53:23,582 INFO [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29b75b5a035966f9b7d1aa40c20581da columnFamilyName family1 2023-10-30 21:53:23,584 INFO [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] regionserver.HStore(310): Store=29b75b5a035966f9b7d1aa40c20581da/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:23,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:23,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:23,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:23,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:53:23,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 29b75b5a035966f9b7d1aa40c20581da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71097212, jitterRate=0.05943101644515991}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:53:23,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:23,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da., pid=11, masterSystemTime=1698702803567 2023-10-30 21:53:23,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:23,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:23,601 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=29b75b5a035966f9b7d1aa40c20581da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:23,601 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698702803601"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702803601"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702803601"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702803601"}]},"ts":"1698702803601"} 2023-10-30 21:53:23,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-30 21:53:23,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 29b75b5a035966f9b7d1aa40c20581da, server=jenkins-hbase4.apache.org,44371,1698702798019 in 190 msec 2023-10-30 21:53:23,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-30 21:53:23,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=29b75b5a035966f9b7d1aa40c20581da, ASSIGN in 353 msec 2023-10-30 21:53:23,613 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:53:23,613 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702803613"}]},"ts":"1698702803613"} 2023-10-30 21:53:23,615 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-10-30 21:53:23,618 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:53:23,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2410 sec 2023-10-30 21:53:24,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-30 21:53:24,513 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-10-30 21:53:24,530 DEBUG [hconnection-0x42e4db32-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:53:24,533 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:53:24,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:24,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:24,709 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:24,709 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:24,710 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 21:53:24,710 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 21:53:24,711 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:24,712 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:24,713 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:24,713 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:24,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:24,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:24,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:24,714 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:24,714 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:24,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:24,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:24,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:24,716 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:24,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:24,721 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 21:53:24,721 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:24,722 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 21:53:24,722 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:24,722 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:24,723 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:24,723 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. started... 2023-10-30 21:53:24,724 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 29b75b5a035966f9b7d1aa40c20581da 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 21:53:25,273 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307bb5002edd2d4b81b8cf1ff6cea7ae12 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511307bb5002edd2d4b81b8cf1ff6cea7ae12 2023-10-30 21:53:25,691 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/b9b6d1c90ef84f19bad6e902cd41d218 2023-10-30 21:53:25,703 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/b9b6d1c90ef84f19bad6e902cd41d218 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b9b6d1c90ef84f19bad6e902cd41d218 2023-10-30 21:53:25,713 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b9b6d1c90ef84f19bad6e902cd41d218, entries=1000, sequenceid=5, filesize=175.8 K 2023-10-30 21:53:25,717 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 29b75b5a035966f9b7d1aa40c20581da in 993ms, sequenceid=5, compaction requested=false 2023-10-30 21:53:25,719 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:25,722 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:25,722 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:25,722 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:25,723 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:25,723 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,723 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 21:53:25,723 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 21:53:25,726 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,726 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:25,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:25,726 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,726 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:25,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:25,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:25,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:25,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 21:53:25,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7537d170[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:25,729 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 21:53:25,729 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,732 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 21:53:25,732 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 21:53:25,733 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:25,733 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,733 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:25,738 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 21:53:25,738 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,738 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:25,738 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 21:53:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:25,743 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 21:53:25,743 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:25,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 21:53:25,743 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:25,743 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,743 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:25,746 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,746 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,746 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:25,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:25,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:25,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:25,747 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,750 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:25,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,759 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:25,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:25,759 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:25,759 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:25,759 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:25,760 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:25,760 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,760 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,760 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,760 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,761 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:25,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:25,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:25,763 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:25,763 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:25,864 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:25,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:25,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:25,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:25,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,886 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:25,886 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:25,887 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 21:53:25,887 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 21:53:25,888 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,888 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,890 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:25,890 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:25,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:25,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,891 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:25,891 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:25,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:25,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,892 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,892 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 21:53:25,892 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:25,892 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 21:53:25,892 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 21:53:25,894 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:25,894 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:25,894 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:25,894 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. started... 2023-10-30 21:53:25,895 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 29b75b5a035966f9b7d1aa40c20581da 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 21:53:26,323 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d0743db9186a45ab80c30e6fa614dca0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128d0743db9186a45ab80c30e6fa614dca0 2023-10-30 21:53:26,337 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/eb4f2bc2eb4749d6bf3b61f79b760b7d 2023-10-30 21:53:26,349 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/eb4f2bc2eb4749d6bf3b61f79b760b7d as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb4f2bc2eb4749d6bf3b61f79b760b7d 2023-10-30 21:53:26,359 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb4f2bc2eb4749d6bf3b61f79b760b7d, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 21:53:26,360 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 29b75b5a035966f9b7d1aa40c20581da in 465ms, sequenceid=9, compaction requested=false 2023-10-30 21:53:26,361 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:26,361 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:26,361 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:26,361 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:26,361 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,362 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 21:53:26,362 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 21:53:26,364 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:26,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:26,365 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,365 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:26,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:26,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:26,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:26,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 21:53:26,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@dbf5e0a[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:26,367 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 21:53:26,367 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,369 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,369 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 21:53:26,369 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 21:53:26,369 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:26,369 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,369 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:26,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 21:53:26,372 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:26,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:26,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:26,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 21:53:26,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:26,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:26,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:26,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:26,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 21:53:26,377 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 21:53:26,377 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:26,377 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:26,377 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,377 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:26,384 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,384 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:26,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,385 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:26,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:26,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:26,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:26,386 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:26,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:26,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,391 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:26,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,398 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,398 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,398 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:26,398 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:26,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:26,398 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:26,398 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:26,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:26,399 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,399 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:26,399 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,399 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,399 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:26,400 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:26,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 21:53:26,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:26,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:26,500 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:26,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:26,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:26,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:26,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,514 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:26,514 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:26,515 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 21:53:26,515 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 21:53:26,516 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,516 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,517 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:26,517 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:26,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:26,518 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:26,518 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:26,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:26,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,519 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,519 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 21:53:26,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:26,520 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 21:53:26,520 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:26,520 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 21:53:26,525 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:26,525 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:26,525 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:26,525 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. started... 2023-10-30 21:53:26,525 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 29b75b5a035966f9b7d1aa40c20581da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:26,945 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:53:26,958 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011f88502c5bb8466abffc6e5201fb4fdf to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512011f88502c5bb8466abffc6e5201fb4fdf 2023-10-30 21:53:27,012 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-30 21:53:27,014 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-30 21:53:27,015 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-30 21:53:27,016 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-30 21:53:27,377 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/257492650800419a8dd97d807437a54e 2023-10-30 21:53:27,388 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/257492650800419a8dd97d807437a54e as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/257492650800419a8dd97d807437a54e 2023-10-30 21:53:27,398 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/257492650800419a8dd97d807437a54e, entries=1, sequenceid=13, filesize=5.0 K 2023-10-30 21:53:27,400 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 29b75b5a035966f9b7d1aa40c20581da in 875ms, sequenceid=13, compaction requested=true 2023-10-30 21:53:27,400 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:27,400 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:27,400 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 21:53:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 21:53:27,403 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,403 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:27,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:27,403 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,403 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:27,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:27,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:27,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:27,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 21:53:27,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cfbc3d4[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:27,405 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 21:53:27,405 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,407 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,407 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 21:53:27,407 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 21:53:27,407 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:27,407 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,407 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:27,412 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,412 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 21:53:27,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,412 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:27,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:27,412 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 21:53:27,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:27,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:27,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:27,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:27,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 21:53:27,416 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 21:53:27,416 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:27,416 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:27,416 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,416 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:27,418 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,418 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,418 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:27,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:27,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:27,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:27,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:27,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:27,419 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:27,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,421 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:27,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,426 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,426 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,426 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,426 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,426 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,426 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,426 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:27,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 21:53:27,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:27,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:27,426 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,426 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:27,427 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:27,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:27,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:27,428 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:27,428 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:27,528 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:27,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:27,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:27,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:27,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,541 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:27,541 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:27,542 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 21:53:27,542 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 21:53:27,542 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,543 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,544 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,544 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:27,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:27,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:27,544 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:27,545 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:27,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:27,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,546 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,546 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 21:53:27,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:27,546 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 21:53:27,546 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:27,547 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 21:53:27,547 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:27,547 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:27,547 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:27,547 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. started... 2023-10-30 21:53:27,547 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 29b75b5a035966f9b7d1aa40c20581da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:27,977 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120565cf759aefec45fabe6848a9a2895ee9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120565cf759aefec45fabe6848a9a2895ee9 2023-10-30 21:53:28,397 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/eb62cb46c513409a8e9a5ec831a82d1c 2023-10-30 21:53:28,407 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/eb62cb46c513409a8e9a5ec831a82d1c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb62cb46c513409a8e9a5ec831a82d1c 2023-10-30 21:53:28,417 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb62cb46c513409a8e9a5ec831a82d1c, entries=1, sequenceid=17, filesize=5.0 K 2023-10-30 21:53:28,418 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 29b75b5a035966f9b7d1aa40c20581da in 871ms, sequenceid=17, compaction requested=true 2023-10-30 21:53:28,418 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:28,418 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:28,418 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:28,426 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:28,426 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,426 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 21:53:28,426 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 21:53:28,430 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,430 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:28,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:28,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:28,432 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,432 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:28,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 21:53:28,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40f38913[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:28,434 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 21:53:28,434 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,436 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,436 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 21:53:28,436 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 21:53:28,436 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:28,436 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,436 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:28,438 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,438 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 21:53:28,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:28,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:28,438 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:28,439 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 21:53:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:28,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:28,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 21:53:28,459 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 21:53:28,459 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:28,459 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:28,459 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,459 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:28,461 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,461 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:28,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:28,461 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:28,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:28,462 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:28,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:28,473 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:28,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,480 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:28,480 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:28,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:28,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:28,480 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:28,481 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,480 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:28,481 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:28,481 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 21:53:28,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:28,481 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:28,482 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,482 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,482 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:28,482 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:28,582 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:28,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:28,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:28,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:28,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,594 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:28,595 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:28,595 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 21:53:28,595 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 21:53:28,596 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,596 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,597 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:28,597 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:28,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:28,598 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,598 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:28,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:28,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,599 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,600 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 21:53:28,600 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,600 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 21:53:28,600 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:28,601 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 21:53:28,601 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:28,601 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:28,601 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:28,601 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. started... 2023-10-30 21:53:28,601 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 29b75b5a035966f9b7d1aa40c20581da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:28,626 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512289b84bdc1624e49638a8e25a847768260 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289b84bdc1624e49638a8e25a847768260 2023-10-30 21:53:28,642 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/9cbdfbeb4d5d4c329357e93ec7ae6f85 2023-10-30 21:53:28,652 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/9cbdfbeb4d5d4c329357e93ec7ae6f85 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9cbdfbeb4d5d4c329357e93ec7ae6f85 2023-10-30 21:53:28,661 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9cbdfbeb4d5d4c329357e93ec7ae6f85, entries=1, sequenceid=21, filesize=5.0 K 2023-10-30 21:53:28,662 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 29b75b5a035966f9b7d1aa40c20581da in 61ms, sequenceid=21, compaction requested=true 2023-10-30 21:53:28,662 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:28,662 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:28,662 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 21:53:28,663 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 21:53:28,669 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,669 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:28,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:28,669 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,669 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:28,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 21:53:28,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b046c2c[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:28,673 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 21:53:28,673 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,675 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 21:53:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 21:53:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:28,675 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,675 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:28,678 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 21:53:28,678 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,678 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:28,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:28,678 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 21:53:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:28,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:28,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:28,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 21:53:28,683 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 21:53:28,683 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:28,683 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:28,683 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,683 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:28,685 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,685 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,685 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:28,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:28,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:28,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:28,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,686 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:28,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,688 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:28,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,691 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:28,691 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:28,691 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:28,691 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:28,691 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:28,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:28,692 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,692 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,692 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,692 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,692 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,692 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:28,692 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:28,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:28,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:28,793 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:28,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:28,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:28,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:28,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,813 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:28,813 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:28,814 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 21:53:28,814 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 21:53:28,815 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,815 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,816 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:28,816 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:28,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:28,817 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:28,817 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:28,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:28,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,818 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,819 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 21:53:28,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:28,819 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 21:53:28,819 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:28,819 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 21:53:28,824 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:28,824 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:28,824 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:28,824 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. started... 2023-10-30 21:53:28,824 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 29b75b5a035966f9b7d1aa40c20581da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:29,261 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123188ef7a0a8f204886994597b619359763 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123188ef7a0a8f204886994597b619359763 2023-10-30 21:53:29,674 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/55a205444a1d4a58b69b8d73aafdde66 2023-10-30 21:53:29,684 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/55a205444a1d4a58b69b8d73aafdde66 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/55a205444a1d4a58b69b8d73aafdde66 2023-10-30 21:53:29,691 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/55a205444a1d4a58b69b8d73aafdde66, entries=1, sequenceid=25, filesize=5.0 K 2023-10-30 21:53:29,693 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 29b75b5a035966f9b7d1aa40c20581da in 869ms, sequenceid=25, compaction requested=true 2023-10-30 21:53:29,693 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:29,693 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:29,693 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:29,694 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:29,694 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,694 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 21:53:29,694 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 21:53:29,696 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,696 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:29,697 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,697 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:29,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:29,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:29,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:29,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 21:53:29,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cbc2c48[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:29,699 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 21:53:29,699 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,700 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,700 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 21:53:29,700 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 21:53:29,701 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,701 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:29,701 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:29,703 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,703 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 21:53:29,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:29,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:29,703 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:29,704 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 21:53:29,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:29,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:29,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:29,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:29,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 21:53:29,708 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 21:53:29,708 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:29,708 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:29,708 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,708 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:29,710 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,710 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:29,710 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:29,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:29,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:29,711 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:29,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,713 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:29,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,715 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,715 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,715 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:29,715 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:29,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 21:53:29,715 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:29,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:29,715 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:29,715 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:29,716 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:29,716 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,717 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,717 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:29,717 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:29,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:29,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:29,817 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:29,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:29,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:29,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:29,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,829 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:29,829 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:29,830 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 21:53:29,830 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 21:53:29,830 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,830 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,832 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:29,832 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:29,832 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:29,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,832 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:29,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:29,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,833 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,834 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 21:53:29,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 21:53:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 21:53:29,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:29,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:29,835 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:29,835 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. started... 2023-10-30 21:53:29,835 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 29b75b5a035966f9b7d1aa40c20581da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:30,262 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101dab088a0b6684b7f83380d8bba130085 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101dab088a0b6684b7f83380d8bba130085 2023-10-30 21:53:30,294 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/0fd5900efc2e4e758fdcfdf1bb691ebe 2023-10-30 21:53:30,303 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/0fd5900efc2e4e758fdcfdf1bb691ebe as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0fd5900efc2e4e758fdcfdf1bb691ebe 2023-10-30 21:53:30,314 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0fd5900efc2e4e758fdcfdf1bb691ebe, entries=1, sequenceid=29, filesize=5.0 K 2023-10-30 21:53:30,316 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 29b75b5a035966f9b7d1aa40c20581da in 481ms, sequenceid=29, compaction requested=true 2023-10-30 21:53:30,316 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:30,316 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:30,317 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:30,317 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,317 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 21:53:30,317 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 21:53:30,320 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,320 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:30,320 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,320 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:30,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 21:53:30,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e7bb568[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:30,322 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 21:53:30,322 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,324 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,324 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 21:53:30,324 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 21:53:30,324 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,324 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:30,324 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:30,325 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 21:53:30,326 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,326 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:30,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,326 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 21:53:30,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:30,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:30,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:30,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:30,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:30,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 21:53:30,330 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 21:53:30,330 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:30,330 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:30,330 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,330 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:30,333 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,333 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:30,333 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:30,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:30,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:30,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:30,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,334 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,336 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,342 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,342 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:30,342 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:30,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:30,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:30,342 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:30,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:30,342 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,342 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:30,343 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,343 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:30,343 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:30,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:30,344 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:30,344 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,344 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,444 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:30,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:30,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:30,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:30,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,488 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:30,488 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:30,488 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 21:53:30,488 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 21:53:30,489 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,489 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,491 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,491 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:30,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:30,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:30,491 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,491 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:30,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:30,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,492 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,493 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 21:53:30,493 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:30,493 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 21:53:30,493 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:30,493 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:30,494 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:30,494 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. started... 2023-10-30 21:53:30,494 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 29b75b5a035966f9b7d1aa40c20581da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:30,514 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031dcc2405334d4211bec4ee703b949850 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031dcc2405334d4211bec4ee703b949850 2023-10-30 21:53:30,925 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/3c704b4fe8394d0cbe813431f97320b5 2023-10-30 21:53:30,933 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/3c704b4fe8394d0cbe813431f97320b5 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/3c704b4fe8394d0cbe813431f97320b5 2023-10-30 21:53:30,940 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/3c704b4fe8394d0cbe813431f97320b5, entries=1, sequenceid=33, filesize=5.0 K 2023-10-30 21:53:30,942 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 29b75b5a035966f9b7d1aa40c20581da in 448ms, sequenceid=33, compaction requested=true 2023-10-30 21:53:30,942 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:30,942 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:30,942 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:30,943 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:30,943 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,943 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 21:53:30,943 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 21:53:30,945 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,945 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:30,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:30,945 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,945 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:30,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:30,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:30,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:30,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 21:53:30,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21c04a5[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:30,947 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 21:53:30,948 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,950 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 21:53:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 21:53:30,950 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:30,950 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,950 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:30,951 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 21:53:30,951 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,952 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:30,952 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 21:53:30,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:30,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:30,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:30,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:30,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 21:53:30,955 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 21:53:30,955 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:30,956 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:30,956 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,956 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:30,958 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:30,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:30,958 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,958 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:30,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,960 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:30,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,962 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:30,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,965 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,965 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:30,965 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,965 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,965 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:30,965 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:30,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 21:53:30,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:30,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:30,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:30,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:30,965 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:30,965 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,966 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,966 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:30,966 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:30,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:30,966 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:30,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:31,067 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:31,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:31,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:31,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:31,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,080 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:31,080 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:31,081 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 21:53:31,081 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 21:53:31,081 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,081 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,083 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:31,083 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:31,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:31,084 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,084 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:31,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,085 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,085 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 21:53:31,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,085 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 21:53:31,085 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:31,086 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 21:53:31,086 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:31,086 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:31,086 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:31,086 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. started... 2023-10-30 21:53:31,086 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 29b75b5a035966f9b7d1aa40c20581da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:31,508 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509072650724041034375bdd95c732146172b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509072650724041034375bdd95c732146172b 2023-10-30 21:53:31,918 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/6847fb8e5d584750b6cc9ae4c5afc3ea 2023-10-30 21:53:31,927 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/6847fb8e5d584750b6cc9ae4c5afc3ea as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/6847fb8e5d584750b6cc9ae4c5afc3ea 2023-10-30 21:53:31,935 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/6847fb8e5d584750b6cc9ae4c5afc3ea, entries=1, sequenceid=37, filesize=5.0 K 2023-10-30 21:53:31,936 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 29b75b5a035966f9b7d1aa40c20581da in 850ms, sequenceid=37, compaction requested=true 2023-10-30 21:53:31,936 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:31,936 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:31,936 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:31,937 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:31,937 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,937 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 21:53:31,937 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 21:53:31,939 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,939 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:31,939 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,939 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:31,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 21:53:31,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a516dc6[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:31,941 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 21:53:31,941 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,943 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,943 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 21:53:31,943 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 21:53:31,943 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:31,943 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,943 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:31,946 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 21:53:31,946 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,946 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:31,946 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 21:53:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:31,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:31,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:31,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 21:53:31,949 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 21:53:31,949 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:31,949 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:31,950 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,950 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:31,951 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,951 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:31,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:31,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,951 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:31,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:31,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:31,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:31,952 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,954 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,957 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,957 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,957 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:31,957 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:31,957 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:31,957 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:31,957 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:31,957 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,957 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:31,961 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:31,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:31,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:31,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:31,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:31,962 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:31,962 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:32,062 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:32,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:32,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,076 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:32,076 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:32,077 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-30 21:53:32,077 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-30 21:53:32,077 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,077 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,078 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,079 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:32,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:32,079 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,079 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:32,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,080 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,081 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-30 21:53:32,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,081 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-30 21:53:32,081 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:32,082 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-30 21:53:32,083 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:32,083 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:32,083 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:32,083 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. started... 2023-10-30 21:53:32,083 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 29b75b5a035966f9b7d1aa40c20581da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:32,507 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a749832ebb5b412aa056591f8aac35d0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120a749832ebb5b412aa056591f8aac35d0 2023-10-30 21:53:32,924 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/0f1b039858ed47f4b423c302d97c9c30 2023-10-30 21:53:32,932 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/0f1b039858ed47f4b423c302d97c9c30 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0f1b039858ed47f4b423c302d97c9c30 2023-10-30 21:53:32,939 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0f1b039858ed47f4b423c302d97c9c30, entries=1, sequenceid=41, filesize=5.0 K 2023-10-30 21:53:32,941 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 29b75b5a035966f9b7d1aa40c20581da in 858ms, sequenceid=41, compaction requested=true 2023-10-30 21:53:32,941 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:32,941 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:32,941 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:32,942 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:32,942 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,942 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-30 21:53:32,942 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-30 21:53:32,949 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,949 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:32,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:32,949 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,949 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:32,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-30 21:53:32,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3792daa8[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:32,951 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-30 21:53:32,952 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,953 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,953 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,953 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:32,955 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-30 21:53:32,955 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-30 21:53:32,955 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:32,960 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-30 21:53:32,960 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,960 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:32,960 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-30 21:53:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:32,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:32,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:32,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:32,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:32,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-30 21:53:32,969 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-30 21:53:32,969 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:32,969 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:32,969 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,969 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:32,972 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,973 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,973 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:32,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:32,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:32,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:32,973 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:32,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,976 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,978 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:32,979 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:32,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:32,979 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:32,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-30 21:53:32,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-30 21:53:32,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:32,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:32,980 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:32,980 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:32,981 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,981 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,981 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,981 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:32,981 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,981 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:32,981 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:33,080 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:33,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:33,088 DEBUG [Listener at localhost/36139] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-30 21:53:33,091 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-30 21:53:33,092 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:33,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 21:53:33,108 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 21:53:33,109 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703413109 2023-10-30 21:53:33,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:53:33,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:53:33,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-30 21:53:33,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 21:53:33,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x6c1f825c to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:53:33,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65da97a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:53:33,122 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:33,601 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036f5d7eedca504730963ab4b968ea2396 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601036f5d7eedca504730963ab4b968ea2396 2023-10-30 21:53:33,602 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 21:53:33,620 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:53:33,622 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:53:33,632 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:53:33,633 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:53:33,666 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/15c336f8451a438cb659129ff0270522 first=Optional[r3] last=Optional[r6] 2023-10-30 21:53:33,680 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/15c336f8451a438cb659129ff0270522}] 2023-10-30 21:53:33,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/15c336f8451a438cb659129ff0270522 for inclusion in 29b75b5a035966f9b7d1aa40c20581da/family1 2023-10-30 21:53:33,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 21:53:33,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:53:33,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:33,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/15c336f8451a438cb659129ff0270522 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c0qqf95h5oa490qpqj1vgis7ugtljdr2nvvtlphphu63adk2pepjion82ce6ccub/family1/15c336f8451a438cb659129ff0270522 2023-10-30 21:53:33,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c0qqf95h5oa490qpqj1vgis7ugtljdr2nvvtlphphu63adk2pepjion82ce6ccub/family1/15c336f8451a438cb659129ff0270522 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b20fbb1483244427bfabdc566fa57da7_SeqId_44_ 2023-10-30 21:53:33,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c0qqf95h5oa490qpqj1vgis7ugtljdr2nvvtlphphu63adk2pepjion82ce6ccub/family1/15c336f8451a438cb659129ff0270522 into 29b75b5a035966f9b7d1aa40c20581da/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b20fbb1483244427bfabdc566fa57da7_SeqId_44_ - updating store file list. 2023-10-30 21:53:33,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b20fbb1483244427bfabdc566fa57da7_SeqId_44_ into 29b75b5a035966f9b7d1aa40c20581da/family1 2023-10-30 21:53:33,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c0qqf95h5oa490qpqj1vgis7ugtljdr2nvvtlphphu63adk2pepjion82ce6ccub/family1/15c336f8451a438cb659129ff0270522 into 29b75b5a035966f9b7d1aa40c20581da/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b20fbb1483244427bfabdc566fa57da7_SeqId_44_) 2023-10-30 21:53:33,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c0qqf95h5oa490qpqj1vgis7ugtljdr2nvvtlphphu63adk2pepjion82ce6ccub/family1/15c336f8451a438cb659129ff0270522 2023-10-30 21:53:33,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 21:53:33,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 21:53:33,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 29b75b5a035966f9b7d1aa40c20581da/family1 is initiating minor compaction 2023-10-30 21:53:33,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@f5cb2d9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:53:33,730 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 29b75b5a035966f9b7d1aa40c20581da/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:33,731 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb4f2bc2eb4749d6bf3b61f79b760b7d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/257492650800419a8dd97d807437a54e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb62cb46c513409a8e9a5ec831a82d1c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9cbdfbeb4d5d4c329357e93ec7ae6f85, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/55a205444a1d4a58b69b8d73aafdde66, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0fd5900efc2e4e758fdcfdf1bb691ebe, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/3c704b4fe8394d0cbe813431f97320b5, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/6847fb8e5d584750b6cc9ae4c5afc3ea, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0f1b039858ed47f4b423c302d97c9c30, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b20fbb1483244427bfabdc566fa57da7_SeqId_44_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp, totalSize=50.2 K 2023-10-30 21:53:33,732 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting eb4f2bc2eb4749d6bf3b61f79b760b7d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 21:53:33,732 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 257492650800419a8dd97d807437a54e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 21:53:33,732 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting eb62cb46c513409a8e9a5ec831a82d1c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 21:53:33,732 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 9cbdfbeb4d5d4c329357e93ec7ae6f85, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 21:53:33,732 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 55a205444a1d4a58b69b8d73aafdde66, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 21:53:33,732 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 0fd5900efc2e4e758fdcfdf1bb691ebe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 21:53:33,732 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 3c704b4fe8394d0cbe813431f97320b5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 21:53:33,732 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 6847fb8e5d584750b6cc9ae4c5afc3ea, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 21:53:33,732 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 0f1b039858ed47f4b423c302d97c9c30, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 21:53:33,732 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting b20fbb1483244427bfabdc566fa57da7_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 21:53:33,747 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 21:53:33,749 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:53:33,755 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289b84bdc1624e49638a8e25a847768260 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512289b84bdc1624e49638a8e25a847768260 2023-10-30 21:53:33,756 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123188ef7a0a8f204886994597b619359763 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015123188ef7a0a8f204886994597b619359763 2023-10-30 21:53:33,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101dab088a0b6684b7f83380d8bba130085 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101dab088a0b6684b7f83380d8bba130085 2023-10-30 21:53:33,760 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031dcc2405334d4211bec4ee703b949850 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031dcc2405334d4211bec4ee703b949850 2023-10-30 21:53:33,760 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-10-30 21:53:33,761 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 21:53:33,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:33,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:33,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:33,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:33,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:33,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:33,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:33,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:33,784 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 29b75b5a035966f9b7d1aa40c20581da#family1#compaction#10 average throughput is 0.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:53:34,210 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/c19a8cfda8824f7d810e7a8ecc150cdc as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/c19a8cfda8824f7d810e7a8ecc150cdc 2023-10-30 21:53:34,225 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 29b75b5a035966f9b7d1aa40c20581da/family1 of 29b75b5a035966f9b7d1aa40c20581da into c19a8cfda8824f7d810e7a8ecc150cdc(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:53:34,226 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:34,227 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1698702813728; duration=0sec 2023-10-30 21:53:34,229 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:53:34,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb4f2bc2eb4749d6bf3b61f79b760b7d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/257492650800419a8dd97d807437a54e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb62cb46c513409a8e9a5ec831a82d1c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9cbdfbeb4d5d4c329357e93ec7ae6f85, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/55a205444a1d4a58b69b8d73aafdde66, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0fd5900efc2e4e758fdcfdf1bb691ebe, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/3c704b4fe8394d0cbe813431f97320b5, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/6847fb8e5d584750b6cc9ae4c5afc3ea, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0f1b039858ed47f4b423c302d97c9c30, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b20fbb1483244427bfabdc566fa57da7_SeqId_44_] to archive 2023-10-30 21:53:34,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:53:34,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb4f2bc2eb4749d6bf3b61f79b760b7d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb4f2bc2eb4749d6bf3b61f79b760b7d 2023-10-30 21:53:34,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/257492650800419a8dd97d807437a54e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/257492650800419a8dd97d807437a54e 2023-10-30 21:53:34,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb62cb46c513409a8e9a5ec831a82d1c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/eb62cb46c513409a8e9a5ec831a82d1c 2023-10-30 21:53:34,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9cbdfbeb4d5d4c329357e93ec7ae6f85 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9cbdfbeb4d5d4c329357e93ec7ae6f85 2023-10-30 21:53:34,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/55a205444a1d4a58b69b8d73aafdde66 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/55a205444a1d4a58b69b8d73aafdde66 2023-10-30 21:53:34,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0fd5900efc2e4e758fdcfdf1bb691ebe to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0fd5900efc2e4e758fdcfdf1bb691ebe 2023-10-30 21:53:34,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/3c704b4fe8394d0cbe813431f97320b5 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/3c704b4fe8394d0cbe813431f97320b5 2023-10-30 21:53:34,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/6847fb8e5d584750b6cc9ae4c5afc3ea to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/6847fb8e5d584750b6cc9ae4c5afc3ea 2023-10-30 21:53:34,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0f1b039858ed47f4b423c302d97c9c30 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/0f1b039858ed47f4b423c302d97c9c30 2023-10-30 21:53:34,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b20fbb1483244427bfabdc566fa57da7_SeqId_44_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b20fbb1483244427bfabdc566fa57da7_SeqId_44_ 2023-10-30 21:53:34,646 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205433035b964014939ab6f09f0c7ecff62 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205433035b964014939ab6f09f0c7ecff62 2023-10-30 21:53:34,650 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 21:53:34,682 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f56ff879fd9f424baf32caa40dec7c0c first=Optional[r00] last=Optional[r2] 2023-10-30 21:53:34,683 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f56ff879fd9f424baf32caa40dec7c0c}] 2023-10-30 21:53:34,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f56ff879fd9f424baf32caa40dec7c0c for inclusion in 29b75b5a035966f9b7d1aa40c20581da/family1 2023-10-30 21:53:34,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 21:53:34,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:53:34,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:34,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f56ff879fd9f424baf32caa40dec7c0c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v9m0pvsrpfqicogs6ou7n1vevka09gqa68644ste1edcn4nrojvm6eb53p7ssbng/family1/f56ff879fd9f424baf32caa40dec7c0c 2023-10-30 21:53:34,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v9m0pvsrpfqicogs6ou7n1vevka09gqa68644ste1edcn4nrojvm6eb53p7ssbng/family1/f56ff879fd9f424baf32caa40dec7c0c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9275079e325340b0ba808557342ced9e_SeqId_47_ 2023-10-30 21:53:34,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v9m0pvsrpfqicogs6ou7n1vevka09gqa68644ste1edcn4nrojvm6eb53p7ssbng/family1/f56ff879fd9f424baf32caa40dec7c0c into 29b75b5a035966f9b7d1aa40c20581da/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9275079e325340b0ba808557342ced9e_SeqId_47_ - updating store file list. 2023-10-30 21:53:34,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9275079e325340b0ba808557342ced9e_SeqId_47_ into 29b75b5a035966f9b7d1aa40c20581da/family1 2023-10-30 21:53:34,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v9m0pvsrpfqicogs6ou7n1vevka09gqa68644ste1edcn4nrojvm6eb53p7ssbng/family1/f56ff879fd9f424baf32caa40dec7c0c into 29b75b5a035966f9b7d1aa40c20581da/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9275079e325340b0ba808557342ced9e_SeqId_47_) 2023-10-30 21:53:34,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v9m0pvsrpfqicogs6ou7n1vevka09gqa68644ste1edcn4nrojvm6eb53p7ssbng/family1/f56ff879fd9f424baf32caa40dec7c0c 2023-10-30 21:53:34,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 21:53:34,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 21:53:34,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 29b75b5a035966f9b7d1aa40c20581da/family1 is initiating minor compaction (all files) 2023-10-30 21:53:34,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1b8c53fb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:53:34,709 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 29b75b5a035966f9b7d1aa40c20581da/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:34,710 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b9b6d1c90ef84f19bad6e902cd41d218, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/c19a8cfda8824f7d810e7a8ecc150cdc, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9275079e325340b0ba808557342ced9e_SeqId_47_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp, totalSize=358.6 K 2023-10-30 21:53:34,711 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting b9b6d1c90ef84f19bad6e902cd41d218, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822322 2023-10-30 21:53:34,712 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting c19a8cfda8824f7d810e7a8ecc150cdc, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222322 2023-10-30 21:53:34,712 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 9275079e325340b0ba808557342ced9e_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878822322 2023-10-30 21:53:34,714 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 21:53:34,716 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:53:34,718 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511307bb5002edd2d4b81b8cf1ff6cea7ae12 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511307bb5002edd2d4b81b8cf1ff6cea7ae12 2023-10-30 21:53:34,720 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512011f88502c5bb8466abffc6e5201fb4fdf to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512011f88502c5bb8466abffc6e5201fb4fdf 2023-10-30 21:53:34,721 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120565cf759aefec45fabe6848a9a2895ee9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120565cf759aefec45fabe6848a9a2895ee9 2023-10-30 21:53:34,721 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-10-30 21:53:34,721 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 21:53:34,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:34,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 21:53:34,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:53:34,724 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 21:53:34,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6260 sec 2023-10-30 21:53:34,749 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 29b75b5a035966f9b7d1aa40c20581da#family1#compaction#11 average throughput is 7.87 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:53:34,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 21:53:34,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:34,941 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-30 21:53:34,943 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-30 21:53:34,943 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-30 21:53:34,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-10-30 21:53:34,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=29b75b5a035966f9b7d1aa40c20581da, REOPEN/MOVE}] 2023-10-30 21:53:34,963 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=29b75b5a035966f9b7d1aa40c20581da, REOPEN/MOVE 2023-10-30 21:53:34,964 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=29b75b5a035966f9b7d1aa40c20581da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:34,964 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698702814964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702814964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702814964"}]},"ts":"1698702814964"} 2023-10-30 21:53:34,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 29b75b5a035966f9b7d1aa40c20581da, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:53:35,123 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:35,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 29b75b5a035966f9b7d1aa40c20581da, disabling compactions & flushes 2023-10-30 21:53:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:35,206 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/.tmp/family1/4172ca75af394b8499489041e0f12891 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/4172ca75af394b8499489041e0f12891 2023-10-30 21:53:35,213 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 29b75b5a035966f9b7d1aa40c20581da/family1 of 29b75b5a035966f9b7d1aa40c20581da into 4172ca75af394b8499489041e0f12891(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:53:35,213 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:35,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:35,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:35,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. after waiting 0 ms 2023-10-30 21:53:35,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:35,215 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1698702814709; duration=0sec 2023-10-30 21:53:35,215 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:53:35,219 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b9b6d1c90ef84f19bad6e902cd41d218, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/c19a8cfda8824f7d810e7a8ecc150cdc, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9275079e325340b0ba808557342ced9e_SeqId_47_] to archive 2023-10-30 21:53:35,220 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:53:35,222 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b9b6d1c90ef84f19bad6e902cd41d218 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/b9b6d1c90ef84f19bad6e902cd41d218 2023-10-30 21:53:35,223 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/c19a8cfda8824f7d810e7a8ecc150cdc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/c19a8cfda8824f7d810e7a8ecc150cdc 2023-10-30 21:53:35,225 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9275079e325340b0ba808557342ced9e_SeqId_47_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/9275079e325340b0ba808557342ced9e_SeqId_47_ 2023-10-30 21:53:35,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 21:53:35,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:35,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:35,232 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 29b75b5a035966f9b7d1aa40c20581da to self. 2023-10-30 21:53:35,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:35,234 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=29b75b5a035966f9b7d1aa40c20581da, regionState=CLOSED 2023-10-30 21:53:35,234 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698702815234"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702815234"}]},"ts":"1698702815234"} 2023-10-30 21:53:35,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-10-30 21:53:35,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 29b75b5a035966f9b7d1aa40c20581da, server=jenkins-hbase4.apache.org,44371,1698702798019 in 269 msec 2023-10-30 21:53:35,239 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=29b75b5a035966f9b7d1aa40c20581da, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=true 2023-10-30 21:53:35,389 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=29b75b5a035966f9b7d1aa40c20581da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:35,390 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698702815389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702815389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702815389"}]},"ts":"1698702815389"} 2023-10-30 21:53:35,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 29b75b5a035966f9b7d1aa40c20581da, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:53:35,544 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:35,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:35,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 29b75b5a035966f9b7d1aa40c20581da, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:53:35,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:35,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:35,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:35,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:35,550 INFO [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:35,551 DEBUG [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1 2023-10-30 21:53:35,551 DEBUG [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1 2023-10-30 21:53:35,552 INFO [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 29b75b5a035966f9b7d1aa40c20581da columnFamilyName family1 2023-10-30 21:53:35,559 DEBUG [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/4172ca75af394b8499489041e0f12891 2023-10-30 21:53:35,559 INFO [StoreOpener-29b75b5a035966f9b7d1aa40c20581da-1] regionserver.HStore(310): Store=29b75b5a035966f9b7d1aa40c20581da/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:35,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:35,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:35,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:53:35,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 29b75b5a035966f9b7d1aa40c20581da; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75270479, jitterRate=0.12161754071712494}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:53:35,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:35,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da., pid=17, masterSystemTime=1698702815544 2023-10-30 21:53:35,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:35,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:53:35,571 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=29b75b5a035966f9b7d1aa40c20581da, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:35,571 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698702815571"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702815571"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702815571"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702815571"}]},"ts":"1698702815571"} 2023-10-30 21:53:35,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-10-30 21:53:35,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 29b75b5a035966f9b7d1aa40c20581da, server=jenkins-hbase4.apache.org,44371,1698702798019 in 181 msec 2023-10-30 21:53:35,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-30 21:53:35,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=29b75b5a035966f9b7d1aa40c20581da, REOPEN/MOVE in 613 msec 2023-10-30 21:53:35,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-10-30 21:53:35,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 632 msec 2023-10-30 21:53:35,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 668 msec 2023-10-30 21:53:35,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-10-30 21:53:35,593 INFO [Listener at localhost/36139] compactions.TestMobCompactor(278): alter status finished 2023-10-30 21:53:35,594 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-30 21:53:35,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 21:53:35,597 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 21:53:35,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:53:35,598 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703415598 2023-10-30 21:53:35,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:53:35,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-30 21:53:35,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 21:53:35,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x5a508240 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:53:35,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a1f59e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:53:35,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:35,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:35,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:35,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:35,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:35,656 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285db4b075412c4dcbb346223641a1a084 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285db4b075412c4dcbb346223641a1a084 2023-10-30 21:53:35,657 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 21:53:35,671 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:53:35,673 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:53:35,682 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:53:35,683 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:53:35,695 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b42561440eb64934ae81a53cfcbd5c52 first=Optional[r05] last=Optional[r8] 2023-10-30 21:53:35,695 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b42561440eb64934ae81a53cfcbd5c52}] 2023-10-30 21:53:35,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b42561440eb64934ae81a53cfcbd5c52 for inclusion in 29b75b5a035966f9b7d1aa40c20581da/family1 2023-10-30 21:53:35,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-30 21:53:35,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:53:35,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:53:35,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b42561440eb64934ae81a53cfcbd5c52 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h0arjgvki503lsn6s4lcqdk6hs3j6bnmcn2iv0doj875t9g17eah68mhm8bcmhmv/family1/b42561440eb64934ae81a53cfcbd5c52 2023-10-30 21:53:35,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h0arjgvki503lsn6s4lcqdk6hs3j6bnmcn2iv0doj875t9g17eah68mhm8bcmhmv/family1/b42561440eb64934ae81a53cfcbd5c52 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/e2f586ae7127465dba8ccddc85dc3a73_SeqId_53_ 2023-10-30 21:53:35,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h0arjgvki503lsn6s4lcqdk6hs3j6bnmcn2iv0doj875t9g17eah68mhm8bcmhmv/family1/b42561440eb64934ae81a53cfcbd5c52 into 29b75b5a035966f9b7d1aa40c20581da/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/e2f586ae7127465dba8ccddc85dc3a73_SeqId_53_ - updating store file list. 2023-10-30 21:53:35,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/e2f586ae7127465dba8ccddc85dc3a73_SeqId_53_ into 29b75b5a035966f9b7d1aa40c20581da/family1 2023-10-30 21:53:35,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h0arjgvki503lsn6s4lcqdk6hs3j6bnmcn2iv0doj875t9g17eah68mhm8bcmhmv/family1/b42561440eb64934ae81a53cfcbd5c52 into 29b75b5a035966f9b7d1aa40c20581da/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/family1/e2f586ae7127465dba8ccddc85dc3a73_SeqId_53_) 2023-10-30 21:53:35,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__h0arjgvki503lsn6s4lcqdk6hs3j6bnmcn2iv0doj875t9g17eah68mhm8bcmhmv/family1/b42561440eb64934ae81a53cfcbd5c52 2023-10-30 21:53:35,716 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 21:53:35,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:53:35,719 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120a749832ebb5b412aa056591f8aac35d0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120a749832ebb5b412aa056591f8aac35d0 2023-10-30 21:53:35,720 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128d0743db9186a45ab80c30e6fa614dca0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128d0743db9186a45ab80c30e6fa614dca0 2023-10-30 21:53:35,720 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-10-30 21:53:35,720 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 21:53:35,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:35,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:35,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-30 21:53:35,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-30 21:53:35,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:53:35,722 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-30 21:53:35,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 127 msec 2023-10-30 21:53:35,811 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 213) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60556 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60702 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60654 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60692 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56981@0x6c1f825c-SendThread(127.0.0.1:56981) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60554 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33fcde0a-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33fcde0a-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60518 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:44371-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60600 [Waiting for operation #26] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60540 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60730 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56981@0x5a508240-SendThread(127.0.0.1:56981) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1428629620_17 at /127.0.0.1:60662 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60644 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33fcde0a-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74b7719f-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60726 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56981@0x6c1f825c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/474723131.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60496 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56981@0x6c1f825c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60672 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74b7719f-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33fcde0a-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60682 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x74b7719f-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56981@0x5a508240-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x33fcde0a-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56981@0x5a508240 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/474723131.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:60572 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=596 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 318), ProcessCount=169 (was 169), AvailableMemoryMB=15533 (was 15370) - AvailableMemoryMB LEAK? - 2023-10-30 21:53:35,823 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=596, MaxFileDescriptor=60000, SystemLoadAverage=301, ProcessCount=169, AvailableMemoryMB=15533 2023-10-30 21:53:35,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 21:53:35,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:35,830 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:53:35,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-10-30 21:53:35,831 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:53:35,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 21:53:35,833 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da 2023-10-30 21:53:35,834 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da empty. 2023-10-30 21:53:35,834 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da 2023-10-30 21:53:35,834 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-10-30 21:53:35,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 21:53:36,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 21:53:36,258 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 21:53:36,259 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9d593f9a29a626d8061e5169c6a744da, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:53:36,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 21:53:36,666 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:36,667 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 9d593f9a29a626d8061e5169c6a744da, disabling compactions & flushes 2023-10-30 21:53:36,667 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:36,667 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:36,667 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. after waiting 0 ms 2023-10-30 21:53:36,667 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:36,667 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:36,667 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:36,670 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:53:36,671 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698702816671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702816671"}]},"ts":"1698702816671"} 2023-10-30 21:53:36,673 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 21:53:36,674 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:53:36,674 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702816674"}]},"ts":"1698702816674"} 2023-10-30 21:53:36,675 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-30 21:53:36,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=9d593f9a29a626d8061e5169c6a744da, ASSIGN}] 2023-10-30 21:53:36,680 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=9d593f9a29a626d8061e5169c6a744da, ASSIGN 2023-10-30 21:53:36,681 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=9d593f9a29a626d8061e5169c6a744da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:53:36,832 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=9d593f9a29a626d8061e5169c6a744da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:36,832 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698702816832"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702816832"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702816832"}]},"ts":"1698702816832"} 2023-10-30 21:53:36,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 9d593f9a29a626d8061e5169c6a744da, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:53:36,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 21:53:36,987 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:36,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:36,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d593f9a29a626d8061e5169c6a744da, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:53:36,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 9d593f9a29a626d8061e5169c6a744da 2023-10-30 21:53:36,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:36,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9d593f9a29a626d8061e5169c6a744da 2023-10-30 21:53:36,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9d593f9a29a626d8061e5169c6a744da 2023-10-30 21:53:36,993 INFO [StoreOpener-9d593f9a29a626d8061e5169c6a744da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9d593f9a29a626d8061e5169c6a744da 2023-10-30 21:53:36,995 DEBUG [StoreOpener-9d593f9a29a626d8061e5169c6a744da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1 2023-10-30 21:53:36,995 DEBUG [StoreOpener-9d593f9a29a626d8061e5169c6a744da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1 2023-10-30 21:53:36,996 INFO [StoreOpener-9d593f9a29a626d8061e5169c6a744da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d593f9a29a626d8061e5169c6a744da columnFamilyName family1 2023-10-30 21:53:36,998 INFO [StoreOpener-9d593f9a29a626d8061e5169c6a744da-1] regionserver.HStore(310): Store=9d593f9a29a626d8061e5169c6a744da/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:36,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da 2023-10-30 21:53:37,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da 2023-10-30 21:53:37,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9d593f9a29a626d8061e5169c6a744da 2023-10-30 21:53:37,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:53:37,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9d593f9a29a626d8061e5169c6a744da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61751416, jitterRate=-0.07983219623565674}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:53:37,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:37,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da., pid=21, masterSystemTime=1698702816987 2023-10-30 21:53:37,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:37,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:37,010 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=9d593f9a29a626d8061e5169c6a744da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:37,011 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698702817010"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702817010"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702817010"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702817010"}]},"ts":"1698702817010"} 2023-10-30 21:53:37,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-10-30 21:53:37,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 9d593f9a29a626d8061e5169c6a744da, server=jenkins-hbase4.apache.org,44371,1698702798019 in 178 msec 2023-10-30 21:53:37,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-10-30 21:53:37,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=9d593f9a29a626d8061e5169c6a744da, ASSIGN in 336 msec 2023-10-30 21:53:37,018 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:53:37,018 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702817018"}]},"ts":"1698702817018"} 2023-10-30 21:53:37,020 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-30 21:53:37,022 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:53:37,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1960 sec 2023-10-30 21:53:37,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-30 21:53:37,940 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-10-30 21:53:37,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:37,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:37,976 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:37,976 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:37,977 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:53:37,977 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:37,977 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:37,977 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:37,980 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:37,980 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:37,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:37,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:37,980 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:37,981 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:37,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:37,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:37,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:37,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:37,981 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:37,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:37,982 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:53:37,982 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:37,982 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:53:37,983 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:37,983 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:37,983 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:37,983 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. started... 2023-10-30 21:53:37,983 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d593f9a29a626d8061e5169c6a744da 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 21:53:38,013 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130542cf8f48dbb4740841d323c9e0febe2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130542cf8f48dbb4740841d323c9e0febe2 2023-10-30 21:53:38,418 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/fa19ead8cdbc4ec0a4dffbb7f3b5f155 2023-10-30 21:53:38,426 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/fa19ead8cdbc4ec0a4dffbb7f3b5f155 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fa19ead8cdbc4ec0a4dffbb7f3b5f155 2023-10-30 21:53:38,432 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fa19ead8cdbc4ec0a4dffbb7f3b5f155, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-30 21:53:38,434 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 9d593f9a29a626d8061e5169c6a744da in 451ms, sequenceid=5, compaction requested=false 2023-10-30 21:53:38,434 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:38,435 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:38,435 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:38,435 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:38,435 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:38,435 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,435 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:53:38,435 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:53:38,437 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,437 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:38,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:38,438 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,438 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:38,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:38,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:38,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:38,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:53:38,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3441f9c7[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:38,439 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:38,439 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,441 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,441 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:38,441 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:53:38,441 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:38,441 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,441 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:38,442 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:53:38,442 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,442 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:38,443 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:53:38,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:38,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:38,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:38,446 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:53:38,446 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:38,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:38,446 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:38,446 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,446 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:38,449 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,449 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:38,449 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:38,450 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:38,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,451 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:38,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,453 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,453 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:38,453 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:38,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:38,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:38,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:53:38,454 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,454 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:38,454 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,454 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:38,454 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,454 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,454 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:38,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:38,455 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:38,455 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:38,555 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:38,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:38,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:38,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:38,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,567 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:38,567 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:38,568 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:53:38,568 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:38,568 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,568 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,570 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,570 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:38,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:38,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:38,571 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:38,571 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:38,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:38,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,572 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,572 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:53:38,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:38,572 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:53:38,573 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:38,573 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:53:38,573 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:38,574 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:38,574 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:38,574 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. started... 2023-10-30 21:53:38,574 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d593f9a29a626d8061e5169c6a744da 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 21:53:38,990 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c89f7fbd1dcf4a8782595bd771570628 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c89f7fbd1dcf4a8782595bd771570628 2023-10-30 21:53:39,396 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/09faa7b903764fe38b38eb1bd2811ed9 2023-10-30 21:53:39,404 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/09faa7b903764fe38b38eb1bd2811ed9 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/09faa7b903764fe38b38eb1bd2811ed9 2023-10-30 21:53:39,409 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/09faa7b903764fe38b38eb1bd2811ed9, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 21:53:39,410 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 9d593f9a29a626d8061e5169c6a744da in 836ms, sequenceid=9, compaction requested=false 2023-10-30 21:53:39,410 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:39,410 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:39,410 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:39,410 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:39,410 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,410 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:53:39,410 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:53:39,412 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,412 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:39,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:39,412 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,412 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:39,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:39,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:39,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:39,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:53:39,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@569aeac6[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:39,414 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:39,414 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,416 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,417 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:39,417 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:53:39,417 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,417 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:39,417 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:39,418 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:53:39,418 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,418 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:39,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,418 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:53:39,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:39,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:39,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:39,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:39,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:39,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:39,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:39,422 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:53:39,422 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:39,422 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:39,422 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,422 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:39,424 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,424 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:39,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,424 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:39,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:39,424 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:39,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:39,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,426 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:39,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,432 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,432 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:39,432 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:39,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:39,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:39,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:39,432 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:39,432 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:39,432 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,433 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,433 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,433 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,433 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:39,434 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:39,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:39,433 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:39,534 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:39,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:39,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:39,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:39,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,544 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:39,544 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:39,544 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:53:39,544 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:39,545 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,545 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,546 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,546 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:39,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:39,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:39,547 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:39,547 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:39,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:39,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,547 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,548 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:53:39,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:53:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:53:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:39,549 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:39,549 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. started... 2023-10-30 21:53:39,549 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d593f9a29a626d8061e5169c6a744da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:39,965 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010355a4a4351e430db4d77444bca37a48 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512010355a4a4351e430db4d77444bca37a48 2023-10-30 21:53:40,371 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/10c1633184094da7a49acdbd796dd3c3 2023-10-30 21:53:40,383 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/10c1633184094da7a49acdbd796dd3c3 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/10c1633184094da7a49acdbd796dd3c3 2023-10-30 21:53:40,390 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/10c1633184094da7a49acdbd796dd3c3, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 21:53:40,391 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d593f9a29a626d8061e5169c6a744da in 842ms, sequenceid=13, compaction requested=true 2023-10-30 21:53:40,392 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:40,392 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:40,392 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:40,392 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:40,392 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,392 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:53:40,392 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:53:40,394 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,394 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:40,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:40,395 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,395 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:40,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:40,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:40,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:53:40,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7704928e[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:40,397 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:40,397 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,400 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,400 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:40,400 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:53:40,400 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:40,401 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,401 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:40,403 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,403 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:53:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,403 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:40,403 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:53:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:40,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:40,408 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:53:40,408 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:40,408 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:40,408 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,408 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:40,411 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,411 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:40,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:40,411 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:40,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:40,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,414 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,416 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,419 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:40,419 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:40,419 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:40,419 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:53:40,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:40,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:40,420 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:40,420 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:40,420 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:40,421 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,421 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,422 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,422 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,420 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:40,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:40,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:40,522 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:40,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:40,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:40,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:40,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,531 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:40,531 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:40,532 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:53:40,532 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:40,533 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,533 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,535 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,535 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:40,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:40,536 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,536 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:40,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:40,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,537 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,537 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:53:40,537 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,537 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:53:40,537 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:53:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:40,538 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:40,538 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:40,538 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. started... 2023-10-30 21:53:40,538 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d593f9a29a626d8061e5169c6a744da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:40,565 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120546fb5d2a5dbd4fdb9238c25343f0b1d1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120546fb5d2a5dbd4fdb9238c25343f0b1d1 2023-10-30 21:53:40,758 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:53:40,980 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/c07c0b439a1a40e0ab220f283e67ccd9 2023-10-30 21:53:40,988 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/c07c0b439a1a40e0ab220f283e67ccd9 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/c07c0b439a1a40e0ab220f283e67ccd9 2023-10-30 21:53:40,994 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/c07c0b439a1a40e0ab220f283e67ccd9, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 21:53:40,996 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d593f9a29a626d8061e5169c6a744da in 458ms, sequenceid=17, compaction requested=true 2023-10-30 21:53:40,996 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:40,996 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:40,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:40,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:40,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:53:40,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:53:40,999 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,999 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:40,999 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:40,999 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:41,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:53:41,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e2415c[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:41,001 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:41,001 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,002 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,003 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:41,003 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:53:41,003 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:41,003 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,003 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:41,007 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,007 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:53:41,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:41,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:41,007 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:41,007 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:53:41,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:41,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:41,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:41,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:41,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:41,011 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:53:41,011 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:41,012 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:41,012 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,012 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:41,014 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,014 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,014 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:41,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:41,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:41,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:41,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:41,015 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:41,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,016 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:41,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,019 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:41,019 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:41,019 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:41,019 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:41,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:41,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:41,019 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,021 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:41,021 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:41,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:53:41,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:41,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:41,121 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:41,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:41,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:41,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:41,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,130 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:41,130 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:41,130 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:53:41,130 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:41,131 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,131 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,132 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,132 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:41,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:41,133 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,133 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:41,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,134 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,134 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:53:41,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:41,134 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:53:41,134 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:41,135 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:53:41,135 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:41,135 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:41,135 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:41,135 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. started... 2023-10-30 21:53:41,135 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d593f9a29a626d8061e5169c6a744da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:41,550 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288460a53d8cec450599fdbc18463de0aa to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288460a53d8cec450599fdbc18463de0aa 2023-10-30 21:53:41,956 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/3fc329c7b7c74481b67cdb4744a1c44f 2023-10-30 21:53:41,962 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/3fc329c7b7c74481b67cdb4744a1c44f as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/3fc329c7b7c74481b67cdb4744a1c44f 2023-10-30 21:53:41,967 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/3fc329c7b7c74481b67cdb4744a1c44f, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 21:53:41,968 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d593f9a29a626d8061e5169c6a744da in 833ms, sequenceid=21, compaction requested=true 2023-10-30 21:53:41,968 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:41,968 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:41,968 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:41,968 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:41,968 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:41,968 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:53:41,968 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:53:42,079 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,079 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:42,079 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,079 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:42,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:53:42,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d561586[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:42,081 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:42,081 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,140 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,140 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,141 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:42,140 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:42,141 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:53:42,141 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:42,171 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,171 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:53:42,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:42,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:42,171 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:42,171 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:53:42,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:42,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:42,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:42,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:42,174 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:53:42,174 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:42,174 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:42,174 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,174 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:42,333 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,333 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:42,333 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:42,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:42,337 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:42,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:42,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:42,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,338 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:42,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,341 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,341 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,341 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,341 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,341 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:42,341 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:53:42,341 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:42,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:42,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:42,341 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:42,341 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:42,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:42,342 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,343 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:42,343 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:42,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:42,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:42,443 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:42,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:42,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:42,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:42,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,451 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:42,451 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:42,451 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:53:42,452 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:42,452 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,452 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,454 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,454 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:42,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:42,454 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:42,454 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,455 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,455 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:53:42,455 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:42,455 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:53:42,455 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:42,456 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:53:42,456 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:42,456 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:42,456 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:42,456 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. started... 2023-10-30 21:53:42,456 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d593f9a29a626d8061e5169c6a744da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:42,871 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310a4e535a44984826bab38e54d941961b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512310a4e535a44984826bab38e54d941961b 2023-10-30 21:53:43,277 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/19783b7453784bc6994410d3bcc46026 2023-10-30 21:53:43,284 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/19783b7453784bc6994410d3bcc46026 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/19783b7453784bc6994410d3bcc46026 2023-10-30 21:53:43,289 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/19783b7453784bc6994410d3bcc46026, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 21:53:43,290 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d593f9a29a626d8061e5169c6a744da in 834ms, sequenceid=25, compaction requested=true 2023-10-30 21:53:43,290 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:43,290 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:43,290 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:43,290 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:43,290 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,290 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:53:43,290 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:53:43,292 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,292 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:43,292 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,292 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:43,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:43,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:53:43,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c9b1e30[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:43,294 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:43,294 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,295 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,295 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:43,296 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:53:43,296 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:43,296 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,296 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:43,297 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,297 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:53:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:43,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:43,297 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:43,297 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:53:43,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:43,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:43,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:43,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:43,300 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:53:43,300 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:43,300 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:43,300 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,300 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:43,302 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,302 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:43,302 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:43,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,302 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,304 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:43,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,306 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,306 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:43,306 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,306 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:43,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:43,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:43,306 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:43,306 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:43,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:43,307 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:53:43,307 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,307 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,307 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:43,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:43,307 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:43,307 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:43,407 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:43,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:43,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:43,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:43,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,415 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:43,415 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:43,416 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:53:43,416 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:43,416 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,416 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,419 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,419 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:43,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:43,419 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:43,419 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:43,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:43,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,420 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,420 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:53:43,420 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:43,420 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:53:43,420 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:43,421 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:53:43,421 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:43,421 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:43,421 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:43,421 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. started... 2023-10-30 21:53:43,421 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d593f9a29a626d8061e5169c6a744da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:43,839 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010106de62ed1f1d4dd9a4ee4944fe0604d5 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010106de62ed1f1d4dd9a4ee4944fe0604d5 2023-10-30 21:53:44,246 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/115e9f2b555f46a28f7204c9c26bde4d 2023-10-30 21:53:44,252 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/115e9f2b555f46a28f7204c9c26bde4d as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/115e9f2b555f46a28f7204c9c26bde4d 2023-10-30 21:53:44,258 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/115e9f2b555f46a28f7204c9c26bde4d, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 21:53:44,259 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d593f9a29a626d8061e5169c6a744da in 838ms, sequenceid=29, compaction requested=true 2023-10-30 21:53:44,259 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:44,259 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:44,260 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:44,260 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:44,260 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,260 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:53:44,260 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:53:44,261 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,261 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:44,262 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,262 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:44,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:44,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:53:44,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f5871cf[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:44,263 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:44,263 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,264 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,264 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:44,264 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:53:44,265 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:44,265 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,265 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:44,266 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:53:44,266 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:44,266 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,266 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:53:44,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:44,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:44,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:44,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:44,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:44,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:44,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:44,269 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:53:44,269 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:44,269 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:44,269 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,269 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:44,271 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,271 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:44,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:44,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,271 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:44,272 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:44,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,273 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:44,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,275 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,275 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,275 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:44,275 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,275 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:44,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:44,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:44,275 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:44,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:44,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:44,275 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,276 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,276 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,276 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:44,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:44,277 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:44,277 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:44,377 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:44,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:44,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:44,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:44,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,387 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:44,387 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:44,388 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:53:44,388 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:44,389 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,389 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,390 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:44,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:44,390 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:44,391 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,391 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:44,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,391 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,392 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:53:44,392 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,393 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:53:44,393 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:44,394 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:53:44,394 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:44,394 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:44,394 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:44,394 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. started... 2023-10-30 21:53:44,394 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d593f9a29a626d8061e5169c6a744da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:44,410 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a5d16b862a724e6499a995f42a751916 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a5d16b862a724e6499a995f42a751916 2023-10-30 21:53:44,816 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/5f2d90f3d7604d6abbee2f6a685b74c7 2023-10-30 21:53:44,823 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/5f2d90f3d7604d6abbee2f6a685b74c7 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/5f2d90f3d7604d6abbee2f6a685b74c7 2023-10-30 21:53:44,829 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/5f2d90f3d7604d6abbee2f6a685b74c7, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 21:53:44,830 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d593f9a29a626d8061e5169c6a744da in 436ms, sequenceid=33, compaction requested=true 2023-10-30 21:53:44,830 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:44,830 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:44,830 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:44,830 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:44,830 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,831 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:53:44,831 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:53:44,832 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,832 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:44,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:44,833 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,833 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:44,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:44,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:44,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:44,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:53:44,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b742fd9[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:44,835 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:44,835 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,837 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,838 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:44,838 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,838 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:44,838 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:53:44,838 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:44,843 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:53:44,843 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,843 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:44,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:44,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:44,844 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:53:44,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:44,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:44,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:44,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:44,847 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:53:44,847 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:44,847 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:44,847 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,847 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:44,848 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,848 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:44,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,849 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:44,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:44,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:44,849 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:44,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:44,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:44,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,850 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:44,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,854 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,854 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,854 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,854 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,854 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,854 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:44,854 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:44,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:44,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:44,854 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:53:44,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:44,854 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:44,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:44,855 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,855 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:44,855 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:44,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:44,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:44,955 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:44,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:44,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:44,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:44,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,963 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:44,963 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:44,964 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:53:44,964 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:44,964 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,964 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,966 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:44,966 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:44,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:44,966 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:44,966 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:44,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:44,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,967 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,967 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:53:44,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:44,967 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:53:44,967 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:44,968 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:53:44,968 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:44,968 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:44,968 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:44,968 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. started... 2023-10-30 21:53:44,968 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d593f9a29a626d8061e5169c6a744da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:45,383 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b4a53ee706574f3b89045f988b3f29ba to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907b4a53ee706574f3b89045f988b3f29ba 2023-10-30 21:53:45,789 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/9315aa5de687431a9d8fffe89fefa6ef 2023-10-30 21:53:45,795 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/9315aa5de687431a9d8fffe89fefa6ef as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/9315aa5de687431a9d8fffe89fefa6ef 2023-10-30 21:53:45,800 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/9315aa5de687431a9d8fffe89fefa6ef, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 21:53:45,801 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d593f9a29a626d8061e5169c6a744da in 833ms, sequenceid=37, compaction requested=true 2023-10-30 21:53:45,801 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:45,801 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:53:45,801 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:53:45,803 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,803 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:45,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,804 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:45,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:53:45,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26d3ff14[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:45,805 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:45,805 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,806 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,807 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:45,807 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:53:45,807 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:45,807 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,807 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:45,809 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:53:45,809 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:45,809 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,809 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:53:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:45,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:45,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:45,812 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:53:45,812 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:45,812 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:45,812 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,812 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:45,814 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,814 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:45,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:45,814 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:45,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:45,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:45,815 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,816 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,818 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,818 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:45,818 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,818 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:45,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:45,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:45,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:53:45,818 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:45,819 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,819 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,818 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:45,819 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:45,819 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:45,819 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,819 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:45,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:45,919 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:45,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:45,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:45,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:45,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,928 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:45,928 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:45,928 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:53:45,928 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:45,929 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,929 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,930 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,930 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:45,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:45,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:45,931 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:45,931 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:45,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:45,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,932 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,932 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:53:45,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:45,932 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:53:45,932 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:45,933 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:53:45,934 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:45,934 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:45,934 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:45,934 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. started... 2023-10-30 21:53:45,934 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 9d593f9a29a626d8061e5169c6a744da 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:45,961 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112090a4008b7dc04123b1ab3ceb655e77d7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112090a4008b7dc04123b1ab3ceb655e77d7 2023-10-30 21:53:46,368 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/ef5920e53f714a55ab85ce9cd1f43331 2023-10-30 21:53:46,375 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/ef5920e53f714a55ab85ce9cd1f43331 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ef5920e53f714a55ab85ce9cd1f43331 2023-10-30 21:53:46,380 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ef5920e53f714a55ab85ce9cd1f43331, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 21:53:46,381 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 9d593f9a29a626d8061e5169c6a744da in 447ms, sequenceid=41, compaction requested=true 2023-10-30 21:53:46,381 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:46,381 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:46,381 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:46,381 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:46,381 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,381 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:53:46,381 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:53:46,384 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,384 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:46,384 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,384 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:46,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:46,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:53:46,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@128d0f60[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:46,386 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:46,386 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,387 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,387 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:46,387 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:53:46,387 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,388 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:46,387 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:46,389 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,389 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:53:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:46,389 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:46,389 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:53:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:46,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:46,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:46,392 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:53:46,392 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:46,392 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:46,392 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,392 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:46,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:46,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:46,394 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:46,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,395 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:46,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,398 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,398 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:46,398 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:46,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:53:46,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-30 21:53:46,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:46,398 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:46,398 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,398 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:46,399 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:46,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:46,400 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,400 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,400 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:46,400 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,400 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:46,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:46,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:46,500 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:46,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:46,503 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-10-30 21:53:46,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:53:46,505 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:53:46,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:53:46,506 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703426506 2023-10-30 21:53:46,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:53:46,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-30 21:53:46,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:53:46,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x6d39847b to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:53:46,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3db9186c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:53:46,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:53:46,956 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103eb8254e6f06a4a9997ed505c6e5abffd to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103eb8254e6f06a4a9997ed505c6e5abffd 2023-10-30 21:53:46,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:53:46,979 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:53:46,981 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:53:46,995 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:53:46,997 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:53:47,019 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d9116ad5c8b3452baf0272ba89e90d6a first=Optional[r5] last=Optional[r6] 2023-10-30 21:53:47,019 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d9116ad5c8b3452baf0272ba89e90d6a}] 2023-10-30 21:53:47,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d9116ad5c8b3452baf0272ba89e90d6a for inclusion in 9d593f9a29a626d8061e5169c6a744da/family1 2023-10-30 21:53:47,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-30 21:53:47,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:53:47,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:47,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d9116ad5c8b3452baf0272ba89e90d6a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nrvfa3k63jrkaugnhf8kdh89nbds0oqrmu58ujdui1rga8mtav4k25d59lf8f28t/family1/d9116ad5c8b3452baf0272ba89e90d6a 2023-10-30 21:53:47,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nrvfa3k63jrkaugnhf8kdh89nbds0oqrmu58ujdui1rga8mtav4k25d59lf8f28t/family1/d9116ad5c8b3452baf0272ba89e90d6a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fb58ed5cba934ab187c3132878c51e53_SeqId_44_ 2023-10-30 21:53:47,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nrvfa3k63jrkaugnhf8kdh89nbds0oqrmu58ujdui1rga8mtav4k25d59lf8f28t/family1/d9116ad5c8b3452baf0272ba89e90d6a into 9d593f9a29a626d8061e5169c6a744da/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fb58ed5cba934ab187c3132878c51e53_SeqId_44_ - updating store file list. 2023-10-30 21:53:47,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fb58ed5cba934ab187c3132878c51e53_SeqId_44_ into 9d593f9a29a626d8061e5169c6a744da/family1 2023-10-30 21:53:47,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nrvfa3k63jrkaugnhf8kdh89nbds0oqrmu58ujdui1rga8mtav4k25d59lf8f28t/family1/d9116ad5c8b3452baf0272ba89e90d6a into 9d593f9a29a626d8061e5169c6a744da/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fb58ed5cba934ab187c3132878c51e53_SeqId_44_) 2023-10-30 21:53:47,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nrvfa3k63jrkaugnhf8kdh89nbds0oqrmu58ujdui1rga8mtav4k25d59lf8f28t/family1/d9116ad5c8b3452baf0272ba89e90d6a 2023-10-30 21:53:47,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 21:53:47,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 21:53:47,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 9d593f9a29a626d8061e5169c6a744da/family1 is initiating minor compaction 2023-10-30 21:53:47,064 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9d593f9a29a626d8061e5169c6a744da/family1 in testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:47,064 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/09faa7b903764fe38b38eb1bd2811ed9, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/10c1633184094da7a49acdbd796dd3c3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/c07c0b439a1a40e0ab220f283e67ccd9, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/3fc329c7b7c74481b67cdb4744a1c44f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/19783b7453784bc6994410d3bcc46026, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/115e9f2b555f46a28f7204c9c26bde4d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/5f2d90f3d7604d6abbee2f6a685b74c7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/9315aa5de687431a9d8fffe89fefa6ef, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ef5920e53f714a55ab85ce9cd1f43331, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fb58ed5cba934ab187c3132878c51e53_SeqId_44_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp, totalSize=49.7 K 2023-10-30 21:53:47,064 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 09faa7b903764fe38b38eb1bd2811ed9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 21:53:47,064 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 10c1633184094da7a49acdbd796dd3c3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 21:53:47,064 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting c07c0b439a1a40e0ab220f283e67ccd9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 21:53:47,065 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 3fc329c7b7c74481b67cdb4744a1c44f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 21:53:47,065 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 19783b7453784bc6994410d3bcc46026, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 21:53:47,065 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 115e9f2b555f46a28f7204c9c26bde4d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 21:53:47,065 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 5f2d90f3d7604d6abbee2f6a685b74c7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 21:53:47,065 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 9315aa5de687431a9d8fffe89fefa6ef, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 21:53:47,065 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting ef5920e53f714a55ab85ce9cd1f43331, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 21:53:47,065 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting fb58ed5cba934ab187c3132878c51e53_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 21:53:47,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7040a29b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:53:47,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:53:47,072 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:53:47,075 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010106de62ed1f1d4dd9a4ee4944fe0604d5 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010106de62ed1f1d4dd9a4ee4944fe0604d5 2023-10-30 21:53:47,076 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a5d16b862a724e6499a995f42a751916 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a5d16b862a724e6499a995f42a751916 2023-10-30 21:53:47,076 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-30 21:53:47,076 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-30 21:53:47,077 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:53:47,077 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:53:47,130 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9d593f9a29a626d8061e5169c6a744da#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:53:47,550 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/e5deeb79480b4edc9738ae6539cee6c6 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/e5deeb79480b4edc9738ae6539cee6c6 2023-10-30 21:53:47,557 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 9d593f9a29a626d8061e5169c6a744da/family1 of 9d593f9a29a626d8061e5169c6a744da into e5deeb79480b4edc9738ae6539cee6c6(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:53:47,557 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:47,557 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698702827064; duration=0sec 2023-10-30 21:53:47,557 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:53:47,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/09faa7b903764fe38b38eb1bd2811ed9, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/10c1633184094da7a49acdbd796dd3c3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/c07c0b439a1a40e0ab220f283e67ccd9, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/3fc329c7b7c74481b67cdb4744a1c44f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/19783b7453784bc6994410d3bcc46026, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/115e9f2b555f46a28f7204c9c26bde4d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/5f2d90f3d7604d6abbee2f6a685b74c7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/9315aa5de687431a9d8fffe89fefa6ef, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ef5920e53f714a55ab85ce9cd1f43331, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fb58ed5cba934ab187c3132878c51e53_SeqId_44_] to archive 2023-10-30 21:53:47,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:53:47,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/09faa7b903764fe38b38eb1bd2811ed9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/09faa7b903764fe38b38eb1bd2811ed9 2023-10-30 21:53:47,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/10c1633184094da7a49acdbd796dd3c3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/10c1633184094da7a49acdbd796dd3c3 2023-10-30 21:53:47,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/c07c0b439a1a40e0ab220f283e67ccd9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/c07c0b439a1a40e0ab220f283e67ccd9 2023-10-30 21:53:47,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/3fc329c7b7c74481b67cdb4744a1c44f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/3fc329c7b7c74481b67cdb4744a1c44f 2023-10-30 21:53:47,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/19783b7453784bc6994410d3bcc46026 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/19783b7453784bc6994410d3bcc46026 2023-10-30 21:53:47,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/115e9f2b555f46a28f7204c9c26bde4d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/115e9f2b555f46a28f7204c9c26bde4d 2023-10-30 21:53:47,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/5f2d90f3d7604d6abbee2f6a685b74c7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/5f2d90f3d7604d6abbee2f6a685b74c7 2023-10-30 21:53:47,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/9315aa5de687431a9d8fffe89fefa6ef to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/9315aa5de687431a9d8fffe89fefa6ef 2023-10-30 21:53:47,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ef5920e53f714a55ab85ce9cd1f43331 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ef5920e53f714a55ab85ce9cd1f43331 2023-10-30 21:53:47,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fb58ed5cba934ab187c3132878c51e53_SeqId_44_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fb58ed5cba934ab187c3132878c51e53_SeqId_44_ 2023-10-30 21:53:47,954 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310dcdfe520b11499f86ee96054712f51d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512310dcdfe520b11499f86ee96054712f51d 2023-10-30 21:53:47,955 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:53:47,981 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/06f1fdfef5224690ab1d8e56ee2d3887 first=Optional[r1] last=Optional[r4] 2023-10-30 21:53:47,982 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/06f1fdfef5224690ab1d8e56ee2d3887}] 2023-10-30 21:53:47,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/06f1fdfef5224690ab1d8e56ee2d3887 for inclusion in 9d593f9a29a626d8061e5169c6a744da/family1 2023-10-30 21:53:47,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-30 21:53:47,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:53:47,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:47,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/06f1fdfef5224690ab1d8e56ee2d3887 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ouu0hh8qt6jiqui9eihj7ar61crqlujcs5gljjh76gj0j02840ghpf0m4c8nndb6/family1/06f1fdfef5224690ab1d8e56ee2d3887 2023-10-30 21:53:47,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ouu0hh8qt6jiqui9eihj7ar61crqlujcs5gljjh76gj0j02840ghpf0m4c8nndb6/family1/06f1fdfef5224690ab1d8e56ee2d3887 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ed499dd621784479b6978bcc0274f30e_SeqId_47_ 2023-10-30 21:53:47,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ouu0hh8qt6jiqui9eihj7ar61crqlujcs5gljjh76gj0j02840ghpf0m4c8nndb6/family1/06f1fdfef5224690ab1d8e56ee2d3887 into 9d593f9a29a626d8061e5169c6a744da/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ed499dd621784479b6978bcc0274f30e_SeqId_47_ - updating store file list. 2023-10-30 21:53:47,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ed499dd621784479b6978bcc0274f30e_SeqId_47_ into 9d593f9a29a626d8061e5169c6a744da/family1 2023-10-30 21:53:47,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ouu0hh8qt6jiqui9eihj7ar61crqlujcs5gljjh76gj0j02840ghpf0m4c8nndb6/family1/06f1fdfef5224690ab1d8e56ee2d3887 into 9d593f9a29a626d8061e5169c6a744da/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ed499dd621784479b6978bcc0274f30e_SeqId_47_) 2023-10-30 21:53:47,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ouu0hh8qt6jiqui9eihj7ar61crqlujcs5gljjh76gj0j02840ghpf0m4c8nndb6/family1/06f1fdfef5224690ab1d8e56ee2d3887 2023-10-30 21:53:47,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 21:53:47,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 21:53:47,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 9d593f9a29a626d8061e5169c6a744da/family1 is initiating minor compaction (all files) 2023-10-30 21:53:47,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@477009da; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:53:47,999 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9d593f9a29a626d8061e5169c6a744da/family1 in testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:53:47,999 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fa19ead8cdbc4ec0a4dffbb7f3b5f155, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/e5deeb79480b4edc9738ae6539cee6c6, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ed499dd621784479b6978bcc0274f30e_SeqId_47_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp, totalSize=178.1 K 2023-10-30 21:53:48,000 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting fa19ead8cdbc4ec0a4dffbb7f3b5f155, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822322 2023-10-30 21:53:48,000 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting e5deeb79480b4edc9738ae6539cee6c6, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222322 2023-10-30 21:53:48,001 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting ed499dd621784479b6978bcc0274f30e_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965222322 2023-10-30 21:53:48,001 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:53:48,002 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:53:48,004 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512010355a4a4351e430db4d77444bca37a48 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512010355a4a4351e430db4d77444bca37a48 2023-10-30 21:53:48,006 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120546fb5d2a5dbd4fdb9238c25343f0b1d1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120546fb5d2a5dbd4fdb9238c25343f0b1d1 2023-10-30 21:53:48,007 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288460a53d8cec450599fdbc18463de0aa to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512288460a53d8cec450599fdbc18463de0aa 2023-10-30 21:53:48,009 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512310a4e535a44984826bab38e54d941961b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512310a4e535a44984826bab38e54d941961b 2023-10-30 21:53:48,009 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-30 21:53:48,009 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-30 21:53:48,010 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:53:48,010 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:53:48,020 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9d593f9a29a626d8061e5169c6a744da#family1#compaction#23 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:53:48,866 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301435e426ed8f46ae9dc764442c54ff6a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511301435e426ed8f46ae9dc764442c54ff6a 2023-10-30 21:53:48,867 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:53:48,896 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2f82352406e4495bbfad3f066e670486 first=Optional[r00] last=Optional[r8] 2023-10-30 21:53:48,897 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2f82352406e4495bbfad3f066e670486}] 2023-10-30 21:53:48,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2f82352406e4495bbfad3f066e670486 for inclusion in 9d593f9a29a626d8061e5169c6a744da/family1 2023-10-30 21:53:48,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-30 21:53:48,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:53:48,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:48,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2f82352406e4495bbfad3f066e670486 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p1toqut4dgm71furu7nt6v4rpem242uje2900k3auv1cfa6it56uh85dmtgn2n9p/family1/2f82352406e4495bbfad3f066e670486 2023-10-30 21:53:48,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p1toqut4dgm71furu7nt6v4rpem242uje2900k3auv1cfa6it56uh85dmtgn2n9p/family1/2f82352406e4495bbfad3f066e670486 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/1073f80b5f534b69958f930f3a0c26df_SeqId_49_ 2023-10-30 21:53:48,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p1toqut4dgm71furu7nt6v4rpem242uje2900k3auv1cfa6it56uh85dmtgn2n9p/family1/2f82352406e4495bbfad3f066e670486 into 9d593f9a29a626d8061e5169c6a744da/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/1073f80b5f534b69958f930f3a0c26df_SeqId_49_ - updating store file list. 2023-10-30 21:53:48,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/1073f80b5f534b69958f930f3a0c26df_SeqId_49_ into 9d593f9a29a626d8061e5169c6a744da/family1 2023-10-30 21:53:48,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p1toqut4dgm71furu7nt6v4rpem242uje2900k3auv1cfa6it56uh85dmtgn2n9p/family1/2f82352406e4495bbfad3f066e670486 into 9d593f9a29a626d8061e5169c6a744da/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/1073f80b5f534b69958f930f3a0c26df_SeqId_49_) 2023-10-30 21:53:48,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithMonthlyPolicy__p1toqut4dgm71furu7nt6v4rpem242uje2900k3auv1cfa6it56uh85dmtgn2n9p/family1/2f82352406e4495bbfad3f066e670486 2023-10-30 21:53:48,912 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:53:48,913 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:53:48,915 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112090a4008b7dc04123b1ab3ceb655e77d7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112090a4008b7dc04123b1ab3ceb655e77d7 2023-10-30 21:53:48,916 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c89f7fbd1dcf4a8782595bd771570628 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c89f7fbd1dcf4a8782595bd771570628 2023-10-30 21:53:48,917 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130542cf8f48dbb4740841d323c9e0febe2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130542cf8f48dbb4740841d323c9e0febe2 2023-10-30 21:53:48,917 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-30 21:53:48,917 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 21:53:48,918 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:53:48,918 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:53:48,918 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:53:48,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:53:48,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:53:48,919 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:53:48,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.4160 sec 2023-10-30 21:53:49,058 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=258 (was 252) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39652 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39614 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56981@0x6d39847b-SendThread(127.0.0.1:56981) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x724dbdcd-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x724dbdcd-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x724dbdcd-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39744 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39576 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39740 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39700 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x724dbdcd-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56981@0x6d39847b sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/474723131.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/cluster_28bfcc88-fd43-a1ce-833d-58e2af823f6c/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/1e1edeb5886643f981ae21c8332ac2b2 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1428629620_17 at /127.0.0.1:60730 [Waiting for operation #29] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x724dbdcd-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:57442 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/cluster_28bfcc88-fd43-a1ce-833d-58e2af823f6c/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39716 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39602 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x724dbdcd-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x724dbdcd-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39726 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39660 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1428629620_17 at /127.0.0.1:39552 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39642 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39802 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39594 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1741365875_17 at /127.0.0.1:39680 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56981@0x6d39847b-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) - Thread LEAK? -, OpenFileDescriptor=616 (was 596) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=273 (was 301), ProcessCount=169 (was 169), AvailableMemoryMB=15299 (was 15533) 2023-10-30 21:53:49,072 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=258, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=273, ProcessCount=169, AvailableMemoryMB=15298 2023-10-30 21:53:49,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 21:53:49,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:49,077 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:53:49,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-10-30 21:53:49,079 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:53:49,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 21:53:49,080 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e 2023-10-30 21:53:49,081 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e empty. 2023-10-30 21:53:49,081 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e 2023-10-30 21:53:49,082 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-10-30 21:53:49,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 21:53:49,261 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/.tmp/family1/1e1edeb5886643f981ae21c8332ac2b2 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/1e1edeb5886643f981ae21c8332ac2b2 2023-10-30 21:53:49,268 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 9d593f9a29a626d8061e5169c6a744da/family1 of 9d593f9a29a626d8061e5169c6a744da into 1e1edeb5886643f981ae21c8332ac2b2(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:53:49,268 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:53:49,268 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698702827999; duration=1sec 2023-10-30 21:53:49,268 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:53:49,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fa19ead8cdbc4ec0a4dffbb7f3b5f155, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/e5deeb79480b4edc9738ae6539cee6c6, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ed499dd621784479b6978bcc0274f30e_SeqId_47_] to archive 2023-10-30 21:53:49,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:53:49,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fa19ead8cdbc4ec0a4dffbb7f3b5f155 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/fa19ead8cdbc4ec0a4dffbb7f3b5f155 2023-10-30 21:53:49,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/e5deeb79480b4edc9738ae6539cee6c6 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/e5deeb79480b4edc9738ae6539cee6c6 2023-10-30 21:53:49,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ed499dd621784479b6978bcc0274f30e_SeqId_47_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/family1/ed499dd621784479b6978bcc0274f30e_SeqId_47_ 2023-10-30 21:53:49,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 21:53:49,491 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 21:53:49,493 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8be07748de4150840684d857f190524e, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:53:49,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 21:53:49,899 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:49,899 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 8be07748de4150840684d857f190524e, disabling compactions & flushes 2023-10-30 21:53:49,899 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:49,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:49,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. after waiting 0 ms 2023-10-30 21:53:49,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:49,900 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:49,900 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:49,903 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:53:49,904 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698702829904"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702829904"}]},"ts":"1698702829904"} 2023-10-30 21:53:49,905 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 21:53:49,906 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:53:49,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702829906"}]},"ts":"1698702829906"} 2023-10-30 21:53:49,908 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-30 21:53:49,916 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8be07748de4150840684d857f190524e, ASSIGN}] 2023-10-30 21:53:49,918 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8be07748de4150840684d857f190524e, ASSIGN 2023-10-30 21:53:49,919 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8be07748de4150840684d857f190524e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:53:50,070 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=8be07748de4150840684d857f190524e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:50,070 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698702830070"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702830070"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702830070"}]},"ts":"1698702830070"} 2023-10-30 21:53:50,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 8be07748de4150840684d857f190524e, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:53:50,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 21:53:50,225 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:50,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:50,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8be07748de4150840684d857f190524e, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:53:50,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 8be07748de4150840684d857f190524e 2023-10-30 21:53:50,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:53:50,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8be07748de4150840684d857f190524e 2023-10-30 21:53:50,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8be07748de4150840684d857f190524e 2023-10-30 21:53:50,231 INFO [StoreOpener-8be07748de4150840684d857f190524e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8be07748de4150840684d857f190524e 2023-10-30 21:53:50,232 DEBUG [StoreOpener-8be07748de4150840684d857f190524e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1 2023-10-30 21:53:50,232 DEBUG [StoreOpener-8be07748de4150840684d857f190524e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1 2023-10-30 21:53:50,233 INFO [StoreOpener-8be07748de4150840684d857f190524e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8be07748de4150840684d857f190524e columnFamilyName family1 2023-10-30 21:53:50,237 INFO [StoreOpener-8be07748de4150840684d857f190524e-1] regionserver.HStore(310): Store=8be07748de4150840684d857f190524e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:53:50,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e 2023-10-30 21:53:50,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e 2023-10-30 21:53:50,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8be07748de4150840684d857f190524e 2023-10-30 21:53:50,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:53:50,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8be07748de4150840684d857f190524e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66562526, jitterRate=-0.00814107060432434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:53:50,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:50,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e., pid=25, masterSystemTime=1698702830224 2023-10-30 21:53:50,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:50,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:50,249 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=8be07748de4150840684d857f190524e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:50,249 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698702830249"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702830249"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702830249"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702830249"}]},"ts":"1698702830249"} 2023-10-30 21:53:50,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-10-30 21:53:50,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 8be07748de4150840684d857f190524e, server=jenkins-hbase4.apache.org,44371,1698702798019 in 179 msec 2023-10-30 21:53:50,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-30 21:53:50,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=8be07748de4150840684d857f190524e, ASSIGN in 337 msec 2023-10-30 21:53:50,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:53:50,257 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702830256"}]},"ts":"1698702830256"} 2023-10-30 21:53:50,258 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-30 21:53:50,260 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:53:50,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1850 sec 2023-10-30 21:53:51,016 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:51,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-30 21:53:51,185 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-10-30 21:53:51,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:51,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:51,211 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:51,211 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:51,211 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:53:51,211 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:51,211 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:51,211 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:51,213 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:51,213 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:51,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:51,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:51,213 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:51,213 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:51,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:51,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:51,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:51,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:51,214 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:51,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:51,214 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:53:51,214 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:51,214 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:53:51,215 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:51,215 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:51,215 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:51,215 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. started... 2023-10-30 21:53:51,215 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8be07748de4150840684d857f190524e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 21:53:51,640 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305cf8b7767910450d8acb2f810f898d8b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511305cf8b7767910450d8acb2f810f898d8b 2023-10-30 21:53:52,044 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/42de624f5c534d60a82314a7043bb19b 2023-10-30 21:53:52,052 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/42de624f5c534d60a82314a7043bb19b as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/42de624f5c534d60a82314a7043bb19b 2023-10-30 21:53:52,059 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/42de624f5c534d60a82314a7043bb19b, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-30 21:53:52,060 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8be07748de4150840684d857f190524e in 845ms, sequenceid=5, compaction requested=false 2023-10-30 21:53:52,061 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:52,061 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:52,061 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:52,061 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:52,061 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,061 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:53:52,061 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:53:52,063 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,063 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:52,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:52,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:52,063 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,063 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:52,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:52,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:52,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:53:52,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e27d2f7[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:52,065 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:52,065 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,066 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,066 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:52,066 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,066 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:52,066 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:53:52,066 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:52,073 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,073 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:53:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:52,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:52,073 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:52,074 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:53:52,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:52,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:52,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:52,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:52,076 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:53:52,076 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:52,076 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:52,076 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,076 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:52,078 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,078 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:52,078 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:52,078 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,080 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,082 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,082 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,082 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,082 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:52,082 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:52,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:52,082 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:52,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:52,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:52,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:53:52,082 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:52,082 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,082 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:52,082 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:52,082 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,083 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:52,183 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:52,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:52,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:52,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:52,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,190 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:52,190 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:52,191 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:53:52,191 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:52,191 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,191 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,192 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,192 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:52,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:52,193 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:52,193 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,194 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,194 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:53:52,194 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:53:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:53:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:52,194 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:52,195 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. started... 2023-10-30 21:53:52,195 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8be07748de4150840684d857f190524e 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 21:53:52,608 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112815aa5a4f8e7c43fe898a7dc584c002b9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112815aa5a4f8e7c43fe898a7dc584c002b9 2023-10-30 21:53:53,015 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/2feef77995f0455ea24b0adf1ccd78aa 2023-10-30 21:53:53,020 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/2feef77995f0455ea24b0adf1ccd78aa as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/2feef77995f0455ea24b0adf1ccd78aa 2023-10-30 21:53:53,025 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/2feef77995f0455ea24b0adf1ccd78aa, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 21:53:53,026 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8be07748de4150840684d857f190524e in 831ms, sequenceid=9, compaction requested=false 2023-10-30 21:53:53,026 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:53,026 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:53:53,026 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:53:53,028 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,028 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:53,028 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,028 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:53,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:53,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:53:53,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34f7320d[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:53,029 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:53,030 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,031 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,031 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:53,031 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:53:53,031 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,031 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:53,031 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:53,032 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:53:53,032 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,032 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:53,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:53,032 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:53:53,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:53,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:53,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:53,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:53,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:53,035 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:53:53,035 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:53,035 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:53,035 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,035 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:53,038 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,038 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:53,038 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:53,038 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,039 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:53,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:53,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:53,042 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:53,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:53,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:53,042 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:53,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:53,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:53,142 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:53,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:53,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:53,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:53,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,164 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:53,164 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:53,164 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:53:53,164 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:53,164 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,164 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,165 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:53,165 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:53,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:53,166 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:53,166 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:53,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:53,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,167 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,167 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:53:53,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:53,167 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:53:53,167 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:53,167 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:53:53,167 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:53,167 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:53,167 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:53,167 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. started... 2023-10-30 21:53:53,168 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8be07748de4150840684d857f190524e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:53,592 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014b70b55f45b44c42933a6f2141eaa2d4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512014b70b55f45b44c42933a6f2141eaa2d4 2023-10-30 21:53:53,998 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/9b09f0f74e74444cbd23aaa41bcdbb62 2023-10-30 21:53:54,004 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/9b09f0f74e74444cbd23aaa41bcdbb62 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/9b09f0f74e74444cbd23aaa41bcdbb62 2023-10-30 21:53:54,009 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/9b09f0f74e74444cbd23aaa41bcdbb62, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 21:53:54,010 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8be07748de4150840684d857f190524e in 842ms, sequenceid=13, compaction requested=true 2023-10-30 21:53:54,010 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:54,010 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:54,010 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:54,011 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:54,011 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,011 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:53:54,011 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:53:54,012 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,012 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:54,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:54,013 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,013 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:54,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:54,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:54,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:54,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:53:54,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d6550d8[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:54,014 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:54,014 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,016 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,016 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:54,017 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:53:54,017 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:54,017 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,017 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:54,018 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:53:54,018 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:54,018 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,018 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:53:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:54,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:54,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:54,020 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:53:54,020 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:54,020 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:54,020 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,020 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:54,022 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,022 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,022 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:54,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:54,022 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,023 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,030 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,030 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:54,030 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:54,030 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:54,030 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,030 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:54,030 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:54,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:53:54,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:54,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:54,031 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,031 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:54,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:54,031 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,031 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:54,031 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:54,131 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:54,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:54,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:54,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:54,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,140 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:54,140 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:54,140 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:53:54,140 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:54,140 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,141 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,142 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:54,142 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:54,142 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,142 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,143 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,143 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,144 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:53:54,144 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:54,144 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:53:54,144 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:54,144 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:54,144 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:54,144 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. started... 2023-10-30 21:53:54,144 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8be07748de4150840684d857f190524e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:54,562 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120573f1fe4681924813868727dfaa4246cd to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120573f1fe4681924813868727dfaa4246cd 2023-10-30 21:53:54,968 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/bb051571842c4e0387677f73e0ebe224 2023-10-30 21:53:54,974 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/bb051571842c4e0387677f73e0ebe224 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/bb051571842c4e0387677f73e0ebe224 2023-10-30 21:53:54,978 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/bb051571842c4e0387677f73e0ebe224, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 21:53:54,979 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8be07748de4150840684d857f190524e in 835ms, sequenceid=17, compaction requested=true 2023-10-30 21:53:54,980 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:54,980 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:54,980 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:54,980 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:54,980 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,980 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:53:54,980 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:53:54,981 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,981 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:54,982 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,982 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:54,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:53:54,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77e9a81b[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:54,983 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:54,983 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,984 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,985 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:54,985 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:53:54,985 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:54,985 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,985 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:54,987 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,987 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:53:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:54,987 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:54,987 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:53:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:54,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:54,989 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:53:54,989 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:54,989 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:54,989 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,989 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:54,991 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,991 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:54,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,991 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:54,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:54,991 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,992 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:54,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,994 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,994 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,994 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,994 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:54,994 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:54,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:54,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:54,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:54,994 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:54,994 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:54,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:54,995 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:54,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:53:54,994 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,995 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:54,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:54,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:54,995 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:54,995 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,095 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:55,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:55,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:55,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:55,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,102 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:55,102 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:55,102 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:53:55,103 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:55,103 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,103 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,104 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,104 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:55,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:55,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:55,104 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,105 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:55,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,105 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,106 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:53:55,106 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,106 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:53:55,106 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:55,106 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:53:55,106 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:55,106 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:55,106 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:55,106 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. started... 2023-10-30 21:53:55,106 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8be07748de4150840684d857f190524e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:55,520 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122841df4508bccf43d98865cd3dc632dab7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122841df4508bccf43d98865cd3dc632dab7 2023-10-30 21:53:55,767 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:53:55,927 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/b351cf7ce3e947ffa498f74d71f4b4f4 2023-10-30 21:53:55,932 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/b351cf7ce3e947ffa498f74d71f4b4f4 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/b351cf7ce3e947ffa498f74d71f4b4f4 2023-10-30 21:53:55,937 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/b351cf7ce3e947ffa498f74d71f4b4f4, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 21:53:55,938 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8be07748de4150840684d857f190524e in 832ms, sequenceid=21, compaction requested=true 2023-10-30 21:53:55,938 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:55,938 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:55,938 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:55,939 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:55,939 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,939 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:53:55,939 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:53:55,944 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,944 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:55,944 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,944 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:55,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:53:55,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27097c7b[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:55,946 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:55,946 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,947 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,947 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:55,947 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,947 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:55,947 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:53:55,947 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:55,949 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:53:55,949 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:55,949 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,949 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:53:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:55,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:55,951 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:53:55,951 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:55,951 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:55,951 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,951 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:55,953 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,953 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,953 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:55,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:55,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:55,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:55,953 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,955 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,960 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,960 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:55,960 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:55,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:55,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:55,960 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,960 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:55,960 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:55,961 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:55,961 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:55,961 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:55,961 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,961 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,961 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:55,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:56,061 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:56,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:56,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:56,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:56,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,069 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:56,069 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:56,069 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:53:56,069 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:56,070 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,070 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,071 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:56,071 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:56,071 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,071 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,072 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,072 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:53:56,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,072 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:53:56,072 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:56,072 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:53:56,073 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:56,073 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:56,073 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:56,073 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. started... 2023-10-30 21:53:56,073 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8be07748de4150840684d857f190524e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:56,487 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e2065ba9881c4c298eee6351a8bd5c89 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e2065ba9881c4c298eee6351a8bd5c89 2023-10-30 21:53:56,894 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/92e3b31b74fb4e81b1fb55e510997273 2023-10-30 21:53:56,899 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/92e3b31b74fb4e81b1fb55e510997273 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/92e3b31b74fb4e81b1fb55e510997273 2023-10-30 21:53:56,904 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/92e3b31b74fb4e81b1fb55e510997273, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 21:53:56,905 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8be07748de4150840684d857f190524e in 832ms, sequenceid=25, compaction requested=true 2023-10-30 21:53:56,905 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:56,905 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:53:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:53:56,907 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,907 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:56,907 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,907 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:56,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:56,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:56,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:53:56,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a6345cd[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:56,908 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:56,909 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,910 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,910 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:56,910 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,910 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:56,910 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:53:56,910 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:56,912 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:53:56,912 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,912 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:56,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:56,913 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:56,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:56,915 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:53:56,915 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:56,915 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:56,915 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,915 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:56,921 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,921 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:56,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:56,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,921 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:56,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:56,922 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:56,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,923 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:56,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:56,925 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:56,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:56,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:56,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:56,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:56,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:56,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,926 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:56,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:53:56,926 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:56,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:56,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:56,926 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,926 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:56,926 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:56,926 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,026 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:57,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:57,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:57,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:57,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,033 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:57,033 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:57,033 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:53:57,034 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:57,034 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,034 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,037 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:57,037 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:57,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:57,037 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,037 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:57,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:57,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,038 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,038 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:53:57,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:53:57,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:57,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:53:57,039 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:57,039 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:57,039 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:57,039 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. started... 2023-10-30 21:53:57,039 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8be07748de4150840684d857f190524e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:57,453 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101fc5c0a1a4a2c4837842d0401c72e159a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101fc5c0a1a4a2c4837842d0401c72e159a 2023-10-30 21:53:57,859 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/625f0e733ea545bc9af579ac7ad7c563 2023-10-30 21:53:57,865 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/625f0e733ea545bc9af579ac7ad7c563 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/625f0e733ea545bc9af579ac7ad7c563 2023-10-30 21:53:57,870 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/625f0e733ea545bc9af579ac7ad7c563, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 21:53:57,871 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8be07748de4150840684d857f190524e in 832ms, sequenceid=29, compaction requested=true 2023-10-30 21:53:57,871 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:57,871 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:57,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:57,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:57,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:53:57,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:53:57,873 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@da733c9[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:57,874 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:57,874 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,875 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,876 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:57,876 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:53:57,876 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,876 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:57,876 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:57,877 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:53:57,877 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,877 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:57,877 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:57,879 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:53:57,879 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:57,879 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:57,879 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,880 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:57,882 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,882 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:57,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,882 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:57,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:57,882 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,883 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:57,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:53:57,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:57,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:57,885 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:57,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:57,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:57,886 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,886 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,886 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:57,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:57,886 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:57,886 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:57,886 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,986 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:57,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:57,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:57,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:57,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,993 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:57,993 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:57,994 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:53:57,994 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:57,994 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,994 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,995 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,995 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:57,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:57,995 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:57,996 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,996 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,997 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:53:57,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:57,997 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:53:57,997 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:57,997 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:53:57,997 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:57,997 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:57,997 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:57,997 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. started... 2023-10-30 21:53:57,997 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8be07748de4150840684d857f190524e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:58,412 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e396b6e74fa742d9aaaefafdce37eea2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e396b6e74fa742d9aaaefafdce37eea2 2023-10-30 21:53:58,821 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/cb0a741211204fd7b524c16e1c4fd816 2023-10-30 21:53:58,828 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/cb0a741211204fd7b524c16e1c4fd816 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/cb0a741211204fd7b524c16e1c4fd816 2023-10-30 21:53:58,833 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/cb0a741211204fd7b524c16e1c4fd816, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 21:53:58,835 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8be07748de4150840684d857f190524e in 838ms, sequenceid=33, compaction requested=true 2023-10-30 21:53:58,835 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:58,835 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:58,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:58,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:58,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:53:58,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:53:58,837 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,837 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:58,837 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,837 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:53:58,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3734eb16[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:58,838 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:58,839 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,841 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,841 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:58,841 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:53:58,841 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:58,841 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,841 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:58,842 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,842 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:53:58,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:58,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:58,842 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:58,843 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:53:58,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:58,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:58,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:58,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:53:58,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:58,845 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:53:58,845 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:58,845 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:58,845 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,845 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:58,846 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,846 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:58,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:58,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,846 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:58,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:58,847 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:58,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:58,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:58,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,848 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:58,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,850 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,850 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:58,850 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:58,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:58,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:58,850 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:58,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:58,850 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:58,850 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,850 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,850 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,850 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:58,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:58,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:58,850 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,850 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:58,851 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,951 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:58,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:58,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:58,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:58,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,958 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:58,958 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:58,958 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:53:58,958 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:58,958 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,958 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,961 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,961 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:58,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:58,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:58,961 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:58,961 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:58,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,962 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,962 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:53:58,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:58,962 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:53:58,962 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:58,962 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:53:58,963 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:58,963 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:58,963 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:58,963 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. started... 2023-10-30 21:53:58,963 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8be07748de4150840684d857f190524e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:53:59,376 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907141398c9e6134a33bbdcf496c05455bf to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907141398c9e6134a33bbdcf496c05455bf 2023-10-30 21:53:59,782 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/0bddc4a604d040a9ba2840fb54fa9d9d 2023-10-30 21:53:59,789 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/0bddc4a604d040a9ba2840fb54fa9d9d as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/0bddc4a604d040a9ba2840fb54fa9d9d 2023-10-30 21:53:59,794 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/0bddc4a604d040a9ba2840fb54fa9d9d, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 21:53:59,795 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8be07748de4150840684d857f190524e in 832ms, sequenceid=37, compaction requested=true 2023-10-30 21:53:59,795 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:53:59,795 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:59,795 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:53:59,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:53:59,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:53:59,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:53:59,797 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,797 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:59,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:59,798 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,798 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:53:59,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:59,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:59,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:59,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:53:59,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bb2a32f[Count = 0] remaining members to acquire global barrier 2023-10-30 21:53:59,800 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:53:59,800 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,805 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,805 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:53:59,806 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:53:59,806 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:53:59,808 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:53:59,808 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:59,808 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,808 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:53:59,808 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:53:59,808 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:53:59,808 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:53:59,808 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:53:59,808 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:53:59,808 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,808 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:53:59,810 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,810 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,810 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:53:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:53:59,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:59,811 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:53:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:53:59,812 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:53:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,815 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,815 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:59,815 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:53:59,815 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:59,815 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:53:59,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:59,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:53:59,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:53:59,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:59,816 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,816 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,816 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,816 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,816 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:53:59,816 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,816 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:53:59,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:53:59,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:53:59,916 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:53:59,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:53:59,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:53:59,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:53:59,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,923 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:53:59,924 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:59,924 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:53:59,924 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:53:59,924 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,924 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,925 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:53:59,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:53:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:53:59,926 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:53:59,926 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:53:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:53:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,927 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,927 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:53:59,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:53:59,927 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:53:59,927 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:53:59,927 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:53:59,927 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:53:59,927 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:53:59,927 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:53:59,927 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. started... 2023-10-30 21:53:59,927 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8be07748de4150840684d857f190524e 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:00,347 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120fc401003172e4009898e0079c49c53f1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120fc401003172e4009898e0079c49c53f1 2023-10-30 21:54:00,753 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/736c86f76e414d6f9438d952d671586a 2023-10-30 21:54:00,759 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/736c86f76e414d6f9438d952d671586a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/736c86f76e414d6f9438d952d671586a 2023-10-30 21:54:00,763 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/736c86f76e414d6f9438d952d671586a, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 21:54:00,764 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8be07748de4150840684d857f190524e in 837ms, sequenceid=41, compaction requested=true 2023-10-30 21:54:00,765 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:54:00,765 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:54:00,765 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:00,765 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:00,765 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,765 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:00,765 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:00,766 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,767 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:00,767 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,767 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bcfc8b9[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:00,768 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:00,768 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,770 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:00,770 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,770 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:00,772 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:00,772 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,772 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:00,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:00,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:00,772 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:00,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:00,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:00,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:00,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:00,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:00,774 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:00,775 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:00,775 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:00,775 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,775 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:00,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:00,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:00,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:00,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:00,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:00,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:00,777 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:00,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,778 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:00,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,780 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,780 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:00,780 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-30 21:54:00,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:00,780 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:54:00,780 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:00,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:00,780 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:00,781 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:00,780 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:00,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:00,781 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:00,781 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:00,781 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,781 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,881 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:00,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:00,884 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-10-30 21:54:00,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:54:00,886 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:54:00,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:00,887 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703440887 2023-10-30 21:54:00,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 21:54:00,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-30 21:54:00,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:00,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x515bc1bc to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:54:00,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ee7ad8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:54:00,898 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:01,746 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103181fe32819d841e48bd968deafcf795e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103181fe32819d841e48bd968deafcf795e 2023-10-30 21:54:01,749 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:01,768 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:54:01,769 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:54:01,781 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:54:01,783 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:54:01,797 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5426fe85ebe54d0cb11ca0f5fa8b3016 first=Optional[r3] last=Optional[r6] 2023-10-30 21:54:01,801 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5426fe85ebe54d0cb11ca0f5fa8b3016}] 2023-10-30 21:54:01,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5426fe85ebe54d0cb11ca0f5fa8b3016 for inclusion in 8be07748de4150840684d857f190524e/family1 2023-10-30 21:54:01,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 21:54:01,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:01,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:54:01,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5426fe85ebe54d0cb11ca0f5fa8b3016 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b2sdla2q3k84ncvtonb1vkjv0ji524sapm02jdjhdg4ku8p2he7ttrmm01uo940k/family1/5426fe85ebe54d0cb11ca0f5fa8b3016 2023-10-30 21:54:01,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b2sdla2q3k84ncvtonb1vkjv0ji524sapm02jdjhdg4ku8p2he7ttrmm01uo940k/family1/5426fe85ebe54d0cb11ca0f5fa8b3016 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/c33f6731e6f44a619cc4578fffdb2af1_SeqId_44_ 2023-10-30 21:54:01,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b2sdla2q3k84ncvtonb1vkjv0ji524sapm02jdjhdg4ku8p2he7ttrmm01uo940k/family1/5426fe85ebe54d0cb11ca0f5fa8b3016 into 8be07748de4150840684d857f190524e/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/c33f6731e6f44a619cc4578fffdb2af1_SeqId_44_ - updating store file list. 2023-10-30 21:54:01,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/c33f6731e6f44a619cc4578fffdb2af1_SeqId_44_ into 8be07748de4150840684d857f190524e/family1 2023-10-30 21:54:01,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b2sdla2q3k84ncvtonb1vkjv0ji524sapm02jdjhdg4ku8p2he7ttrmm01uo940k/family1/5426fe85ebe54d0cb11ca0f5fa8b3016 into 8be07748de4150840684d857f190524e/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/c33f6731e6f44a619cc4578fffdb2af1_SeqId_44_) 2023-10-30 21:54:01,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b2sdla2q3k84ncvtonb1vkjv0ji524sapm02jdjhdg4ku8p2he7ttrmm01uo940k/family1/5426fe85ebe54d0cb11ca0f5fa8b3016 2023-10-30 21:54:01,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 21:54:01,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 21:54:01,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 8be07748de4150840684d857f190524e/family1 is initiating minor compaction 2023-10-30 21:54:01,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@72744c3e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:01,835 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8be07748de4150840684d857f190524e/family1 in testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:54:01,835 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/2feef77995f0455ea24b0adf1ccd78aa, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/9b09f0f74e74444cbd23aaa41bcdbb62, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/bb051571842c4e0387677f73e0ebe224, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/b351cf7ce3e947ffa498f74d71f4b4f4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/92e3b31b74fb4e81b1fb55e510997273, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/625f0e733ea545bc9af579ac7ad7c563, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/cb0a741211204fd7b524c16e1c4fd816, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/0bddc4a604d040a9ba2840fb54fa9d9d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/736c86f76e414d6f9438d952d671586a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/c33f6731e6f44a619cc4578fffdb2af1_SeqId_44_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp, totalSize=50.0 K 2023-10-30 21:54:01,836 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 2feef77995f0455ea24b0adf1ccd78aa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 21:54:01,836 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 9b09f0f74e74444cbd23aaa41bcdbb62, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 21:54:01,836 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting bb051571842c4e0387677f73e0ebe224, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 21:54:01,836 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting b351cf7ce3e947ffa498f74d71f4b4f4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 21:54:01,836 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 92e3b31b74fb4e81b1fb55e510997273, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 21:54:01,836 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 625f0e733ea545bc9af579ac7ad7c563, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 21:54:01,836 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting cb0a741211204fd7b524c16e1c4fd816, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 21:54:01,836 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 0bddc4a604d040a9ba2840fb54fa9d9d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 21:54:01,836 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 736c86f76e414d6f9438d952d671586a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 21:54:01,836 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting c33f6731e6f44a619cc4578fffdb2af1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 21:54:01,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:01,841 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:01,843 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122841df4508bccf43d98865cd3dc632dab7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122841df4508bccf43d98865cd3dc632dab7 2023-10-30 21:54:01,845 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e2065ba9881c4c298eee6351a8bd5c89 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e2065ba9881c4c298eee6351a8bd5c89 2023-10-30 21:54:01,847 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101fc5c0a1a4a2c4837842d0401c72e159a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101fc5c0a1a4a2c4837842d0401c72e159a 2023-10-30 21:54:01,849 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e396b6e74fa742d9aaaefafdce37eea2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e396b6e74fa742d9aaaefafdce37eea2 2023-10-30 21:54:01,849 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-30 21:54:01,849 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 21:54:01,856 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:01,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:01,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:01,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:01,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:01,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:01,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:01,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:01,933 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8be07748de4150840684d857f190524e#family1#compaction#34 average throughput is 0.14 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:54:02,757 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205005885b8e2bf41d897bd29f5c0639cd4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205005885b8e2bf41d897bd29f5c0639cd4 2023-10-30 21:54:02,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:02,763 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/e1f64eaba11c446ea22b51afeb09658b as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/e1f64eaba11c446ea22b51afeb09658b 2023-10-30 21:54:02,770 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8be07748de4150840684d857f190524e/family1 of 8be07748de4150840684d857f190524e into e1f64eaba11c446ea22b51afeb09658b(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:54:02,770 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:54:02,770 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698702841835; duration=0sec 2023-10-30 21:54:02,770 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:02,786 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8165d07a5e5c44188c918d7edf77eff0 first=Optional[r1] last=Optional[r2] 2023-10-30 21:54:02,787 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8165d07a5e5c44188c918d7edf77eff0}] 2023-10-30 21:54:02,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8165d07a5e5c44188c918d7edf77eff0 for inclusion in 8be07748de4150840684d857f190524e/family1 2023-10-30 21:54:02,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-30 21:54:02,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:02,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:54:02,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8165d07a5e5c44188c918d7edf77eff0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pldq7j6d6jbq376dnf47k6jfamfvc6kpubcbovcdf9bdumei28m0lssi0e066hbd/family1/8165d07a5e5c44188c918d7edf77eff0 2023-10-30 21:54:02,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pldq7j6d6jbq376dnf47k6jfamfvc6kpubcbovcdf9bdumei28m0lssi0e066hbd/family1/8165d07a5e5c44188c918d7edf77eff0 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/dbb317fa4cc44263bf9ec50800033f0e_SeqId_47_ 2023-10-30 21:54:02,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pldq7j6d6jbq376dnf47k6jfamfvc6kpubcbovcdf9bdumei28m0lssi0e066hbd/family1/8165d07a5e5c44188c918d7edf77eff0 into 8be07748de4150840684d857f190524e/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/dbb317fa4cc44263bf9ec50800033f0e_SeqId_47_ - updating store file list. 2023-10-30 21:54:02,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/dbb317fa4cc44263bf9ec50800033f0e_SeqId_47_ into 8be07748de4150840684d857f190524e/family1 2023-10-30 21:54:02,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pldq7j6d6jbq376dnf47k6jfamfvc6kpubcbovcdf9bdumei28m0lssi0e066hbd/family1/8165d07a5e5c44188c918d7edf77eff0 into 8be07748de4150840684d857f190524e/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/dbb317fa4cc44263bf9ec50800033f0e_SeqId_47_) 2023-10-30 21:54:02,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithWeeklyPolicy__pldq7j6d6jbq376dnf47k6jfamfvc6kpubcbovcdf9bdumei28m0lssi0e066hbd/family1/8165d07a5e5c44188c918d7edf77eff0 2023-10-30 21:54:02,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 21:54:02,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 21:54:02,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 8be07748de4150840684d857f190524e/family1 is initiating minor compaction (all files) 2023-10-30 21:54:02,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@49b50b5d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:02,803 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8be07748de4150840684d857f190524e/family1 in testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:54:02,803 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/42de624f5c534d60a82314a7043bb19b, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/e1f64eaba11c446ea22b51afeb09658b, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/dbb317fa4cc44263bf9ec50800033f0e_SeqId_47_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp, totalSize=176.8 K 2023-10-30 21:54:02,804 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 42de624f5c534d60a82314a7043bb19b, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822322 2023-10-30 21:54:02,804 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting e1f64eaba11c446ea22b51afeb09658b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222322 2023-10-30 21:54:02,805 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting dbb317fa4cc44263bf9ec50800033f0e_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965222322 2023-10-30 21:54:02,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:02,805 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:02,807 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512014b70b55f45b44c42933a6f2141eaa2d4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512014b70b55f45b44c42933a6f2141eaa2d4 2023-10-30 21:54:02,809 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120573f1fe4681924813868727dfaa4246cd to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120573f1fe4681924813868727dfaa4246cd 2023-10-30 21:54:02,809 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-10-30 21:54:02,809 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 21:54:02,810 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:02,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:02,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:02,811 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:54:02,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.9270 sec 2023-10-30 21:54:02,821 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8be07748de4150840684d857f190524e#family1#compaction#35 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:54:02,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/2feef77995f0455ea24b0adf1ccd78aa, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/9b09f0f74e74444cbd23aaa41bcdbb62, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/bb051571842c4e0387677f73e0ebe224, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/b351cf7ce3e947ffa498f74d71f4b4f4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/92e3b31b74fb4e81b1fb55e510997273, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/625f0e733ea545bc9af579ac7ad7c563, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/cb0a741211204fd7b524c16e1c4fd816, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/0bddc4a604d040a9ba2840fb54fa9d9d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/736c86f76e414d6f9438d952d671586a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/c33f6731e6f44a619cc4578fffdb2af1_SeqId_44_] to archive 2023-10-30 21:54:02,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:02,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/2feef77995f0455ea24b0adf1ccd78aa to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/2feef77995f0455ea24b0adf1ccd78aa 2023-10-30 21:54:02,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/9b09f0f74e74444cbd23aaa41bcdbb62 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/9b09f0f74e74444cbd23aaa41bcdbb62 2023-10-30 21:54:02,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/bb051571842c4e0387677f73e0ebe224 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/bb051571842c4e0387677f73e0ebe224 2023-10-30 21:54:02,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/b351cf7ce3e947ffa498f74d71f4b4f4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/b351cf7ce3e947ffa498f74d71f4b4f4 2023-10-30 21:54:02,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/92e3b31b74fb4e81b1fb55e510997273 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/92e3b31b74fb4e81b1fb55e510997273 2023-10-30 21:54:02,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/625f0e733ea545bc9af579ac7ad7c563 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/625f0e733ea545bc9af579ac7ad7c563 2023-10-30 21:54:02,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/cb0a741211204fd7b524c16e1c4fd816 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/cb0a741211204fd7b524c16e1c4fd816 2023-10-30 21:54:02,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/0bddc4a604d040a9ba2840fb54fa9d9d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/0bddc4a604d040a9ba2840fb54fa9d9d 2023-10-30 21:54:02,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/736c86f76e414d6f9438d952d671586a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/736c86f76e414d6f9438d952d671586a 2023-10-30 21:54:02,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/c33f6731e6f44a619cc4578fffdb2af1_SeqId_44_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/c33f6731e6f44a619cc4578fffdb2af1_SeqId_44_ 2023-10-30 21:54:02,921 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=264 (was 258) - Thread LEAK? -, OpenFileDescriptor=626 (was 616) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=246 (was 273), ProcessCount=169 (was 169), AvailableMemoryMB=15035 (was 15298) 2023-10-30 21:54:02,938 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=264, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=246, ProcessCount=169, AvailableMemoryMB=15032 2023-10-30 21:54:02,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 21:54:02,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:02,945 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:54:02,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-10-30 21:54:02,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 21:54:02,946 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:54:02,949 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e 2023-10-30 21:54:02,950 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530 2023-10-30 21:54:02,951 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e empty. 2023-10-30 21:54:02,955 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172 2023-10-30 21:54:02,955 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530 empty. 2023-10-30 21:54:02,955 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e 2023-10-30 21:54:02,956 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530 2023-10-30 21:54:02,956 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172 empty. 2023-10-30 21:54:02,956 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172 2023-10-30 21:54:02,956 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-10-30 21:54:02,971 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-10-30 21:54:02,973 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 751af663fb4a94faedac2cbca910218e, NAME => 'testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:54:02,978 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 267d79cc122426879ba4819ed95e4172, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:54:02,978 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 13107aa05a22fec95264a0367afc4530, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:54:03,011 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:03,011 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 751af663fb4a94faedac2cbca910218e, disabling compactions & flushes 2023-10-30 21:54:03,011 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:03,011 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:03,011 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. after waiting 0 ms 2023-10-30 21:54:03,011 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:03,011 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:03,011 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 751af663fb4a94faedac2cbca910218e: 2023-10-30 21:54:03,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 21:54:03,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 21:54:03,412 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:03,412 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:03,412 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 13107aa05a22fec95264a0367afc4530, disabling compactions & flushes 2023-10-30 21:54:03,412 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 267d79cc122426879ba4819ed95e4172, disabling compactions & flushes 2023-10-30 21:54:03,412 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:03,412 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:03,412 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:03,412 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:03,412 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. after waiting 0 ms 2023-10-30 21:54:03,412 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. after waiting 0 ms 2023-10-30 21:54:03,412 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:03,412 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:03,412 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:03,413 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:03,413 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 13107aa05a22fec95264a0367afc4530: 2023-10-30 21:54:03,413 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 267d79cc122426879ba4819ed95e4172: 2023-10-30 21:54:03,416 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:54:03,417 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698702843416"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702843416"}]},"ts":"1698702843416"} 2023-10-30 21:54:03,417 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698702843416"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702843416"}]},"ts":"1698702843416"} 2023-10-30 21:54:03,417 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698702843416"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702843416"}]},"ts":"1698702843416"} 2023-10-30 21:54:03,420 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 21:54:03,425 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:54:03,425 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702843425"}]},"ts":"1698702843425"} 2023-10-30 21:54:03,427 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-10-30 21:54:03,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=751af663fb4a94faedac2cbca910218e, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=13107aa05a22fec95264a0367afc4530, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=267d79cc122426879ba4819ed95e4172, ASSIGN}] 2023-10-30 21:54:03,434 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=267d79cc122426879ba4819ed95e4172, ASSIGN 2023-10-30 21:54:03,435 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=13107aa05a22fec95264a0367afc4530, ASSIGN 2023-10-30 21:54:03,435 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=751af663fb4a94faedac2cbca910218e, ASSIGN 2023-10-30 21:54:03,436 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=267d79cc122426879ba4819ed95e4172, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:54:03,436 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=13107aa05a22fec95264a0367afc4530, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:54:03,436 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=751af663fb4a94faedac2cbca910218e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:54:03,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 21:54:03,587 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=13107aa05a22fec95264a0367afc4530, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:03,588 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=267d79cc122426879ba4819ed95e4172, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:03,587 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=751af663fb4a94faedac2cbca910218e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:03,588 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698702843587"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702843587"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702843587"}]},"ts":"1698702843587"} 2023-10-30 21:54:03,588 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698702843588"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702843588"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702843588"}]},"ts":"1698702843588"} 2023-10-30 21:54:03,588 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698702843587"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702843587"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702843587"}]},"ts":"1698702843587"} 2023-10-30 21:54:03,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 13107aa05a22fec95264a0367afc4530, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:03,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 267d79cc122426879ba4819ed95e4172, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:03,591 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 751af663fb4a94faedac2cbca910218e, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:03,742 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:03,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:03,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 13107aa05a22fec95264a0367afc4530, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 21:54:03,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 13107aa05a22fec95264a0367afc4530 2023-10-30 21:54:03,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:03,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 13107aa05a22fec95264a0367afc4530 2023-10-30 21:54:03,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 13107aa05a22fec95264a0367afc4530 2023-10-30 21:54:03,747 INFO [StoreOpener-13107aa05a22fec95264a0367afc4530-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 13107aa05a22fec95264a0367afc4530 2023-10-30 21:54:03,749 DEBUG [StoreOpener-13107aa05a22fec95264a0367afc4530-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530/family1 2023-10-30 21:54:03,749 DEBUG [StoreOpener-13107aa05a22fec95264a0367afc4530-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530/family1 2023-10-30 21:54:03,750 INFO [StoreOpener-13107aa05a22fec95264a0367afc4530-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13107aa05a22fec95264a0367afc4530 columnFamilyName family1 2023-10-30 21:54:03,751 INFO [StoreOpener-13107aa05a22fec95264a0367afc4530-1] regionserver.HStore(310): Store=13107aa05a22fec95264a0367afc4530/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:03,751 INFO [StoreOpener-13107aa05a22fec95264a0367afc4530-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 13107aa05a22fec95264a0367afc4530 2023-10-30 21:54:03,752 DEBUG [StoreOpener-13107aa05a22fec95264a0367afc4530-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530/family2 2023-10-30 21:54:03,752 DEBUG [StoreOpener-13107aa05a22fec95264a0367afc4530-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530/family2 2023-10-30 21:54:03,753 INFO [StoreOpener-13107aa05a22fec95264a0367afc4530-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13107aa05a22fec95264a0367afc4530 columnFamilyName family2 2023-10-30 21:54:03,754 INFO [StoreOpener-13107aa05a22fec95264a0367afc4530-1] regionserver.HStore(310): Store=13107aa05a22fec95264a0367afc4530/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:03,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530 2023-10-30 21:54:03,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530 2023-10-30 21:54:03,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:54:03,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 13107aa05a22fec95264a0367afc4530 2023-10-30 21:54:03,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:54:03,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 13107aa05a22fec95264a0367afc4530; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60608779, jitterRate=-0.09685881435871124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:54:03,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 13107aa05a22fec95264a0367afc4530: 2023-10-30 21:54:03,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530., pid=31, masterSystemTime=1698702843742 2023-10-30 21:54:03,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:03,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:03,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:03,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 751af663fb4a94faedac2cbca910218e, NAME => 'testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 21:54:03,764 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=13107aa05a22fec95264a0367afc4530, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:03,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 751af663fb4a94faedac2cbca910218e 2023-10-30 21:54:03,764 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698702843764"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702843764"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702843764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702843764"}]},"ts":"1698702843764"} 2023-10-30 21:54:03,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:03,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 751af663fb4a94faedac2cbca910218e 2023-10-30 21:54:03,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 751af663fb4a94faedac2cbca910218e 2023-10-30 21:54:03,766 INFO [StoreOpener-751af663fb4a94faedac2cbca910218e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 751af663fb4a94faedac2cbca910218e 2023-10-30 21:54:03,767 DEBUG [StoreOpener-751af663fb4a94faedac2cbca910218e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e/family1 2023-10-30 21:54:03,767 DEBUG [StoreOpener-751af663fb4a94faedac2cbca910218e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e/family1 2023-10-30 21:54:03,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-30 21:54:03,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 13107aa05a22fec95264a0367afc4530, server=jenkins-hbase4.apache.org,44371,1698702798019 in 176 msec 2023-10-30 21:54:03,768 INFO [StoreOpener-751af663fb4a94faedac2cbca910218e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 751af663fb4a94faedac2cbca910218e columnFamilyName family1 2023-10-30 21:54:03,769 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=13107aa05a22fec95264a0367afc4530, ASSIGN in 336 msec 2023-10-30 21:54:03,769 INFO [StoreOpener-751af663fb4a94faedac2cbca910218e-1] regionserver.HStore(310): Store=751af663fb4a94faedac2cbca910218e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:03,769 INFO [StoreOpener-751af663fb4a94faedac2cbca910218e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 751af663fb4a94faedac2cbca910218e 2023-10-30 21:54:03,771 DEBUG [StoreOpener-751af663fb4a94faedac2cbca910218e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e/family2 2023-10-30 21:54:03,771 DEBUG [StoreOpener-751af663fb4a94faedac2cbca910218e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e/family2 2023-10-30 21:54:03,772 INFO [StoreOpener-751af663fb4a94faedac2cbca910218e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 751af663fb4a94faedac2cbca910218e columnFamilyName family2 2023-10-30 21:54:03,773 INFO [StoreOpener-751af663fb4a94faedac2cbca910218e-1] regionserver.HStore(310): Store=751af663fb4a94faedac2cbca910218e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:03,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e 2023-10-30 21:54:03,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e 2023-10-30 21:54:03,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:54:03,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 751af663fb4a94faedac2cbca910218e 2023-10-30 21:54:03,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:54:03,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 751af663fb4a94faedac2cbca910218e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74642339, jitterRate=0.11225752532482147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:54:03,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 751af663fb4a94faedac2cbca910218e: 2023-10-30 21:54:03,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e., pid=33, masterSystemTime=1698702843742 2023-10-30 21:54:03,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:03,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:03,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:03,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 267d79cc122426879ba4819ed95e4172, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 21:54:03,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=751af663fb4a94faedac2cbca910218e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:03,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 267d79cc122426879ba4819ed95e4172 2023-10-30 21:54:03,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:03,781 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698702843781"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702843781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702843781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702843781"}]},"ts":"1698702843781"} 2023-10-30 21:54:03,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 267d79cc122426879ba4819ed95e4172 2023-10-30 21:54:03,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 267d79cc122426879ba4819ed95e4172 2023-10-30 21:54:03,782 INFO [StoreOpener-267d79cc122426879ba4819ed95e4172-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 267d79cc122426879ba4819ed95e4172 2023-10-30 21:54:03,784 DEBUG [StoreOpener-267d79cc122426879ba4819ed95e4172-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1 2023-10-30 21:54:03,784 DEBUG [StoreOpener-267d79cc122426879ba4819ed95e4172-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1 2023-10-30 21:54:03,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=28 2023-10-30 21:54:03,784 INFO [StoreOpener-267d79cc122426879ba4819ed95e4172-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 267d79cc122426879ba4819ed95e4172 columnFamilyName family1 2023-10-30 21:54:03,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 751af663fb4a94faedac2cbca910218e, server=jenkins-hbase4.apache.org,44371,1698702798019 in 191 msec 2023-10-30 21:54:03,785 INFO [StoreOpener-267d79cc122426879ba4819ed95e4172-1] regionserver.HStore(310): Store=267d79cc122426879ba4819ed95e4172/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:03,785 INFO [StoreOpener-267d79cc122426879ba4819ed95e4172-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 267d79cc122426879ba4819ed95e4172 2023-10-30 21:54:03,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=751af663fb4a94faedac2cbca910218e, ASSIGN in 352 msec 2023-10-30 21:54:03,787 DEBUG [StoreOpener-267d79cc122426879ba4819ed95e4172-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family2 2023-10-30 21:54:03,787 DEBUG [StoreOpener-267d79cc122426879ba4819ed95e4172-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family2 2023-10-30 21:54:03,787 INFO [StoreOpener-267d79cc122426879ba4819ed95e4172-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 267d79cc122426879ba4819ed95e4172 columnFamilyName family2 2023-10-30 21:54:03,788 INFO [StoreOpener-267d79cc122426879ba4819ed95e4172-1] regionserver.HStore(310): Store=267d79cc122426879ba4819ed95e4172/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:03,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172 2023-10-30 21:54:03,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172 2023-10-30 21:54:03,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:54:03,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 267d79cc122426879ba4819ed95e4172 2023-10-30 21:54:03,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:54:03,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 267d79cc122426879ba4819ed95e4172; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62276903, jitterRate=-0.07200182974338531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:54:03,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 267d79cc122426879ba4819ed95e4172: 2023-10-30 21:54:03,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172., pid=32, masterSystemTime=1698702843742 2023-10-30 21:54:03,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:03,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:03,797 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=267d79cc122426879ba4819ed95e4172, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:03,797 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698702843797"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702843797"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702843797"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702843797"}]},"ts":"1698702843797"} 2023-10-30 21:54:03,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=30 2023-10-30 21:54:03,800 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 267d79cc122426879ba4819ed95e4172, server=jenkins-hbase4.apache.org,44371,1698702798019 in 208 msec 2023-10-30 21:54:03,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=27 2023-10-30 21:54:03,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=267d79cc122426879ba4819ed95e4172, ASSIGN in 368 msec 2023-10-30 21:54:03,802 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:54:03,802 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702843802"}]},"ts":"1698702843802"} 2023-10-30 21:54:03,803 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-10-30 21:54:03,825 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:54:03,826 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x515bc1bc to 127.0.0.1:56981 2023-10-30 21:54:03,826 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:54:03,826 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:54:03,827 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:54:03,827 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c1f825c to 127.0.0.1:56981 2023-10-30 21:54:03,827 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:54:03,827 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:54:03,827 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a508240 to 127.0.0.1:56981 2023-10-30 21:54:03,827 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:54:03,827 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:54:03,827 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d39847b to 127.0.0.1:56981 2023-10-30 21:54:03,827 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:54:03,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 884 msec 2023-10-30 21:54:04,047 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/.tmp/family1/2387f540957a4386b076184f7c7c948b as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/2387f540957a4386b076184f7c7c948b 2023-10-30 21:54:04,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-30 21:54:04,051 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-10-30 21:54:04,053 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8be07748de4150840684d857f190524e/family1 of 8be07748de4150840684d857f190524e into 2387f540957a4386b076184f7c7c948b(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:54:04,053 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:54:04,054 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1698702842803; duration=1sec 2023-10-30 21:54:04,054 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:04,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:04,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,060 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-30 21:54:04,060 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:04,060 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-30 21:54:04,060 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-30 21:54:04,061 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,061 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,062 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:04,062 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:04,062 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,062 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:04,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:04,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,063 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,064 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,064 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-30 21:54:04,064 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:04,064 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-30 21:54:04,064 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:04,064 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. started... 2023-10-30 21:54:04,064 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:54:04,064 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:04,065 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 751af663fb4a94faedac2cbca910218e: 2023-10-30 21:54:04,064 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:04,065 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:04,064 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:04,065 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:54:04,065 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. started... 2023-10-30 21:54:04,065 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. started... 2023-10-30 21:54:04,066 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 13107aa05a22fec95264a0367afc4530: 2023-10-30 21:54:04,067 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 267d79cc122426879ba4819ed95e4172 2/2 column families, dataSize=48 B heapSize=632 B 2023-10-30 21:54:04,068 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:04,069 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:54:04,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/42de624f5c534d60a82314a7043bb19b, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/e1f64eaba11c446ea22b51afeb09658b, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/dbb317fa4cc44263bf9ec50800033f0e_SeqId_47_] to archive 2023-10-30 21:54:04,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:04,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/42de624f5c534d60a82314a7043bb19b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/42de624f5c534d60a82314a7043bb19b 2023-10-30 21:54:04,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/e1f64eaba11c446ea22b51afeb09658b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/e1f64eaba11c446ea22b51afeb09658b 2023-10-30 21:54:04,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/dbb317fa4cc44263bf9ec50800033f0e_SeqId_47_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/family1/dbb317fa4cc44263bf9ec50800033f0e_SeqId_47_ 2023-10-30 21:54:04,487 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030400a5b49d1d44a368b23f81de5683546 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231030400a5b49d1d44a368b23f81de5683546 2023-10-30 21:54:04,893 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/.tmp/family1/4ce2b2284d79472f8fc6ca8880de0576 2023-10-30 21:54:04,898 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/.tmp/family1/4ce2b2284d79472f8fc6ca8880de0576 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/4ce2b2284d79472f8fc6ca8880de0576 2023-10-30 21:54:04,902 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/4ce2b2284d79472f8fc6ca8880de0576, entries=1, sequenceid=5, filesize=4.9 K 2023-10-30 21:54:04,903 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 267d79cc122426879ba4819ed95e4172 in 836ms, sequenceid=5, compaction requested=false 2023-10-30 21:54:04,903 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-10-30 21:54:04,904 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 267d79cc122426879ba4819ed95e4172: 2023-10-30 21:54:04,904 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:54:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:54:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,904 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-30 21:54:04,905 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-30 21:54:04,906 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,906 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:04,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:04,907 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,907 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:04,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:04,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-30 21:54:04,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fc28772[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:04,908 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-30 21:54:04,908 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,910 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,910 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-30 21:54:04,910 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-30 21:54:04,910 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:04,910 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,910 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:04,915 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,915 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-30 21:54:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:04,915 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:04,915 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-30 21:54:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:04,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:04,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:04,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-30 21:54:04,917 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-30 21:54:04,917 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:04,917 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:04,917 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,917 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:04,919 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,919 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,919 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:04,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:04,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:04,920 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,921 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:04,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:04,926 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:04,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:04,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-30 21:54:04,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:04,926 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,926 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:04,926 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,926 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,926 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:04,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-30 21:54:04,926 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:04,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:04,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:04,926 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:05,027 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:05,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:05,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:05,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:05,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,033 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-30 21:54:05,033 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:05,033 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-30 21:54:05,033 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-30 21:54:05,034 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,034 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,036 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,036 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:05,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:05,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:05,037 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,037 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:05,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,038 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-10-30 21:54:05,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-30 21:54:05,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:05,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-30 21:54:05,038 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:05,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:54:05,038 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:05,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:05,038 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. started... 2023-10-30 21:54:05,038 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:05,039 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. started... 2023-10-30 21:54:05,038 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. started... 2023-10-30 21:54:05,039 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 751af663fb4a94faedac2cbca910218e: 2023-10-30 21:54:05,039 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 13107aa05a22fec95264a0367afc4530: 2023-10-30 21:54:05,039 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:54:05,039 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:54:05,039 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 267d79cc122426879ba4819ed95e4172 2/2 column families, dataSize=90 B heapSize=752 B 2023-10-30 21:54:05,039 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:54:05,039 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:54:05,453 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310304e33d88131b9493f842b9dc9ef7d927e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310304e33d88131b9493f842b9dc9ef7d927e 2023-10-30 21:54:05,859 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/.tmp/family1/71437d6e98194a62ae5987ed610906d9 2023-10-30 21:54:05,864 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/.tmp/family1/71437d6e98194a62ae5987ed610906d9 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/71437d6e98194a62ae5987ed610906d9 2023-10-30 21:54:05,868 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/71437d6e98194a62ae5987ed610906d9, entries=2, sequenceid=9, filesize=5.0 K 2023-10-30 21:54:05,868 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 267d79cc122426879ba4819ed95e4172 in 829ms, sequenceid=9, compaction requested=false 2023-10-30 21:54:05,868 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 267d79cc122426879ba4819ed95e4172: 2023-10-30 21:54:05,868 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:05,869 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:54:05,869 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:54:05,869 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,869 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-30 21:54:05,869 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-30 21:54:05,871 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:05,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:05,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:05,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:05,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:05,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-30 21:54:05,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f3ebbc7[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:05,872 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-30 21:54:05,873 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,874 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,874 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-30 21:54:05,874 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-30 21:54:05,874 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:05,874 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,874 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:05,875 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-30 21:54:05,875 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,875 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:05,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,875 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-30 21:54:05,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:05,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:05,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:05,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:05,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:05,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:05,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-30 21:54:05,878 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-30 21:54:05,878 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:05,878 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:05,878 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,878 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:05,880 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,880 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:05,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:05,880 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:05,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:05,881 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:05,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:05,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:05,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,882 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:05,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:05,885 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:05,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:05,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-30 21:54:05,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:05,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-30 21:54:05,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:05,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:05,885 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:05,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,885 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:05,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:05,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,886 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:05,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:05,986 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:05,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:05,992 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-10-30 21:54:05,994 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-30 21:54:05,995 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-30 21:54:05,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:05,995 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703445995 2023-10-30 21:54:05,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:54:05,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-10-30 21:54:05,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 21:54:05,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x3aca4a1f to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:54:06,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49b2131c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:54:06,002 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-30 21:54:06,830 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030e9d073b1138e4ffe9ba7ef66815e02f4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231030e9d073b1138e4ffe9ba7ef66815e02f4 2023-10-30 21:54:06,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 21:54:06,847 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:54:06,848 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:54:06,860 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:54:06,862 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:54:06,870 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/9884089bd0114150a0fbd2764a6297d8 first=Optional[k0] last=Optional[k1] 2023-10-30 21:54:06,871 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/9884089bd0114150a0fbd2764a6297d8}] 2023-10-30 21:54:06,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/9884089bd0114150a0fbd2764a6297d8 for inclusion in 267d79cc122426879ba4819ed95e4172/family1 2023-10-30 21:54:06,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-10-30 21:54:06,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 21:54:06,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 267d79cc122426879ba4819ed95e4172: 2023-10-30 21:54:06,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030/family1/9884089bd0114150a0fbd2764a6297d8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testScannerOnBulkLoadRefHFiles__jlqgk8cak62srq3t77ao0v32jdnf2foqme7fasngnvhtkm1o8a52aq7k51bh3voq/family1/9884089bd0114150a0fbd2764a6297d8 2023-10-30 21:54:06,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testScannerOnBulkLoadRefHFiles__jlqgk8cak62srq3t77ao0v32jdnf2foqme7fasngnvhtkm1o8a52aq7k51bh3voq/family1/9884089bd0114150a0fbd2764a6297d8 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/37752369ccb84f5b8fa9e78eea6d966b_SeqId_12_ 2023-10-30 21:54:06,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testScannerOnBulkLoadRefHFiles__jlqgk8cak62srq3t77ao0v32jdnf2foqme7fasngnvhtkm1o8a52aq7k51bh3voq/family1/9884089bd0114150a0fbd2764a6297d8 into 267d79cc122426879ba4819ed95e4172/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/37752369ccb84f5b8fa9e78eea6d966b_SeqId_12_ - updating store file list. 2023-10-30 21:54:06,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/37752369ccb84f5b8fa9e78eea6d966b_SeqId_12_ into 267d79cc122426879ba4819ed95e4172/family1 2023-10-30 21:54:06,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testScannerOnBulkLoadRefHFiles__jlqgk8cak62srq3t77ao0v32jdnf2foqme7fasngnvhtkm1o8a52aq7k51bh3voq/family1/9884089bd0114150a0fbd2764a6297d8 into 267d79cc122426879ba4819ed95e4172/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/37752369ccb84f5b8fa9e78eea6d966b_SeqId_12_) 2023-10-30 21:54:06,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testScannerOnBulkLoadRefHFiles__jlqgk8cak62srq3t77ao0v32jdnf2foqme7fasngnvhtkm1o8a52aq7k51bh3voq/family1/9884089bd0114150a0fbd2764a6297d8 2023-10-30 21:54:06,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 21:54:06,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 21:54:06,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 267d79cc122426879ba4819ed95e4172/family1 is initiating minor compaction (all files) 2023-10-30 21:54:06,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@26030636; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:06,887 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 267d79cc122426879ba4819ed95e4172/family1 in testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:54:06,888 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/4ce2b2284d79472f8fc6ca8880de0576, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/71437d6e98194a62ae5987ed610906d9, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/37752369ccb84f5b8fa9e78eea6d966b_SeqId_12_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/.tmp, totalSize=15.1 K 2023-10-30 21:54:06,888 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 4ce2b2284d79472f8fc6ca8880de0576, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702844051 2023-10-30 21:54:06,889 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 71437d6e98194a62ae5987ed610906d9, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702844051 2023-10-30 21:54:06,889 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 37752369ccb84f5b8fa9e78eea6d966b_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702844051 2023-10-30 21:54:06,890 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 21:54:06,890 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:06,893 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231030400a5b49d1d44a368b23f81de5683546 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231030400a5b49d1d44a368b23f81de5683546 2023-10-30 21:54:06,895 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310304e33d88131b9493f842b9dc9ef7d927e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310304e33d88131b9493f842b9dc9ef7d927e 2023-10-30 21:54:06,895 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-10-30 21:54:06,895 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 21:54:06,895 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-30 21:54:06,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-30 21:54:06,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:06,896 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-30 21:54:06,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 903 msec 2023-10-30 21:54:06,901 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 267d79cc122426879ba4819ed95e4172#family1#compaction#38 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:54:06,931 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=250 (was 264), OpenFileDescriptor=603 (was 626), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 246), ProcessCount=169 (was 169), AvailableMemoryMB=14979 (was 15032) 2023-10-30 21:54:06,942 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=250, OpenFileDescriptor=603, MaxFileDescriptor=60000, SystemLoadAverage=235, ProcessCount=169, AvailableMemoryMB=14979 2023-10-30 21:54:06,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 21:54:06,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:06,946 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:54:06,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-10-30 21:54:06,947 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:54:06,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 21:54:06,948 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432 2023-10-30 21:54:06,948 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432 empty. 2023-10-30 21:54:06,949 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432 2023-10-30 21:54:06,949 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-10-30 21:54:07,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 21:54:07,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 21:54:07,357 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 21:54:07,358 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => c3a28ebc198b1a1c5b23a42f79c57432, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:54:07,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 21:54:07,725 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/.tmp/family1/a74fca30f6c1402b9f9268f8de9c536f as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/a74fca30f6c1402b9f9268f8de9c536f 2023-10-30 21:54:07,731 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 267d79cc122426879ba4819ed95e4172/family1 of 267d79cc122426879ba4819ed95e4172 into a74fca30f6c1402b9f9268f8de9c536f(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:54:07,731 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 267d79cc122426879ba4819ed95e4172: 2023-10-30 21:54:07,731 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1698702846887; duration=0sec 2023-10-30 21:54:07,731 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:07,763 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:07,764 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing c3a28ebc198b1a1c5b23a42f79c57432, disabling compactions & flushes 2023-10-30 21:54:07,764 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:07,764 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:07,764 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. after waiting 0 ms 2023-10-30 21:54:07,764 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:07,764 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:07,764 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:07,766 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:54:07,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/4ce2b2284d79472f8fc6ca8880de0576, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/71437d6e98194a62ae5987ed610906d9, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/37752369ccb84f5b8fa9e78eea6d966b_SeqId_12_] to archive 2023-10-30 21:54:07,770 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698702847769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702847769"}]},"ts":"1698702847769"} 2023-10-30 21:54:07,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:07,771 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 21:54:07,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/4ce2b2284d79472f8fc6ca8880de0576 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/4ce2b2284d79472f8fc6ca8880de0576 2023-10-30 21:54:07,772 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:54:07,772 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702847772"}]},"ts":"1698702847772"} 2023-10-30 21:54:07,773 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-30 21:54:07,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/71437d6e98194a62ae5987ed610906d9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/71437d6e98194a62ae5987ed610906d9 2023-10-30 21:54:07,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/37752369ccb84f5b8fa9e78eea6d966b_SeqId_12_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/family1/37752369ccb84f5b8fa9e78eea6d966b_SeqId_12_ 2023-10-30 21:54:07,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=c3a28ebc198b1a1c5b23a42f79c57432, ASSIGN}] 2023-10-30 21:54:07,778 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=c3a28ebc198b1a1c5b23a42f79c57432, ASSIGN 2023-10-30 21:54:07,778 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=c3a28ebc198b1a1c5b23a42f79c57432, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:54:07,929 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c3a28ebc198b1a1c5b23a42f79c57432, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:07,929 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698702847929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702847929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702847929"}]},"ts":"1698702847929"} 2023-10-30 21:54:07,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure c3a28ebc198b1a1c5b23a42f79c57432, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:08,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 21:54:08,083 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:08,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:08,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3a28ebc198b1a1c5b23a42f79c57432, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:54:08,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy c3a28ebc198b1a1c5b23a42f79c57432 2023-10-30 21:54:08,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:08,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3a28ebc198b1a1c5b23a42f79c57432 2023-10-30 21:54:08,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3a28ebc198b1a1c5b23a42f79c57432 2023-10-30 21:54:08,087 INFO [StoreOpener-c3a28ebc198b1a1c5b23a42f79c57432-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c3a28ebc198b1a1c5b23a42f79c57432 2023-10-30 21:54:08,089 DEBUG [StoreOpener-c3a28ebc198b1a1c5b23a42f79c57432-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1 2023-10-30 21:54:08,089 DEBUG [StoreOpener-c3a28ebc198b1a1c5b23a42f79c57432-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1 2023-10-30 21:54:08,089 INFO [StoreOpener-c3a28ebc198b1a1c5b23a42f79c57432-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3a28ebc198b1a1c5b23a42f79c57432 columnFamilyName family1 2023-10-30 21:54:08,091 INFO [StoreOpener-c3a28ebc198b1a1c5b23a42f79c57432-1] regionserver.HStore(310): Store=c3a28ebc198b1a1c5b23a42f79c57432/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:08,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432 2023-10-30 21:54:08,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432 2023-10-30 21:54:08,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3a28ebc198b1a1c5b23a42f79c57432 2023-10-30 21:54:08,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:54:08,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3a28ebc198b1a1c5b23a42f79c57432; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69303190, jitterRate=0.03269800543785095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:54:08,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:08,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432., pid=37, masterSystemTime=1698702848083 2023-10-30 21:54:08,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:08,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:08,101 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c3a28ebc198b1a1c5b23a42f79c57432, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:08,101 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698702848101"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702848101"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702848101"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702848101"}]},"ts":"1698702848101"} 2023-10-30 21:54:08,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-30 21:54:08,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure c3a28ebc198b1a1c5b23a42f79c57432, server=jenkins-hbase4.apache.org,44371,1698702798019 in 171 msec 2023-10-30 21:54:08,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-10-30 21:54:08,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=c3a28ebc198b1a1c5b23a42f79c57432, ASSIGN in 328 msec 2023-10-30 21:54:08,106 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:54:08,106 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702848106"}]},"ts":"1698702848106"} 2023-10-30 21:54:08,107 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-30 21:54:08,109 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:54:08,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1650 sec 2023-10-30 21:54:09,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-30 21:54:09,052 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-10-30 21:54:09,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:09,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,074 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:09,074 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:09,074 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:54:09,074 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:54:09,075 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,075 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,077 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:09,077 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:09,077 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,078 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:09,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,078 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:54:09,079 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:09,079 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:54:09,079 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:09,079 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:09,079 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:09,079 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. started... 2023-10-30 21:54:09,079 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3a28ebc198b1a1c5b23a42f79c57432 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 21:54:09,276 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:54:09,303 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:09,500 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e55b7f587ff443beb8cb32e9e5fcd31c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130e55b7f587ff443beb8cb32e9e5fcd31c 2023-10-30 21:54:09,903 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/5dedd91e25cc4bc8b3ee7815f6c46075 2023-10-30 21:54:09,909 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/5dedd91e25cc4bc8b3ee7815f6c46075 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5dedd91e25cc4bc8b3ee7815f6c46075 2023-10-30 21:54:09,913 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5dedd91e25cc4bc8b3ee7815f6c46075, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-30 21:54:09,914 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c3a28ebc198b1a1c5b23a42f79c57432 in 835ms, sequenceid=5, compaction requested=false 2023-10-30 21:54:09,914 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:09,915 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:09,915 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:09,915 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:09,915 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,915 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:09,915 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:09,916 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,916 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:09,917 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,917 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:09,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:09,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:09,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15bd2d4[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:09,918 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:09,918 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,919 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,919 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:09,919 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:09,919 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:09,919 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,920 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:09,921 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,921 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:09,921 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:09,921 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:09,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:09,923 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:09,923 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:09,923 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:09,923 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,923 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:09,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,925 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:09,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,926 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:09,926 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:09,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,927 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:09,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,929 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,929 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,929 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:09,929 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,929 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:09,929 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:09,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:09,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:09,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:09,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:54:09,929 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,929 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:09,930 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:09,930 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:09,930 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:09,930 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:09,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:09,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:10,030 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:10,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:10,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:10,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:10,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,036 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:10,036 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:10,036 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:54:10,036 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:54:10,037 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,037 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,038 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,038 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:10,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:10,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:10,038 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,038 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:10,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,039 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,039 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:54:10,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,039 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:54:10,039 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:10,039 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:54:10,040 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:10,040 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:10,040 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:10,040 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. started... 2023-10-30 21:54:10,040 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3a28ebc198b1a1c5b23a42f79c57432 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 21:54:10,452 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285bb81b1dac7e4abaa5e180535473a044 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511285bb81b1dac7e4abaa5e180535473a044 2023-10-30 21:54:10,858 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/5a389672cda94b50955e37752e078d92 2023-10-30 21:54:10,863 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/5a389672cda94b50955e37752e078d92 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5a389672cda94b50955e37752e078d92 2023-10-30 21:54:10,867 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5a389672cda94b50955e37752e078d92, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 21:54:10,868 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c3a28ebc198b1a1c5b23a42f79c57432 in 828ms, sequenceid=9, compaction requested=false 2023-10-30 21:54:10,868 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:10,868 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:10,868 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:10,868 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:10,868 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,868 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:10,868 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:10,870 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,870 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:10,870 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,870 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:10,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:10,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14c45846[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:10,871 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:10,872 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,879 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,879 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:10,879 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:10,879 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,879 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:10,879 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:10,880 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:10,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:10,880 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:10,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:10,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:10,883 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:10,883 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:10,883 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:10,883 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,883 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:10,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:10,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:10,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:10,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:10,885 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:10,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:10,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:10,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,886 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:10,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,888 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,888 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,888 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:10,888 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:10,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:10,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:10,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:10,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:54:10,889 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:10,889 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,889 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,889 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:10,889 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:10,889 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,889 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,891 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:10,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:10,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:10,989 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:10,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:10,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:10,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:10,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,996 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:10,996 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:10,996 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:54:10,996 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:54:10,996 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,996 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,998 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,998 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:10,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:10,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:10,999 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:10,999 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:10,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:10,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:10,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,000 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,000 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:54:11,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:54:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:54:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:11,000 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:11,000 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:11,000 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. started... 2023-10-30 21:54:11,000 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3a28ebc198b1a1c5b23a42f79c57432 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:11,413 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201941e12cc350944fcbc2379fd473454e1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201941e12cc350944fcbc2379fd473454e1 2023-10-30 21:54:11,819 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/526ff4dc05e245f6b022893c53701eab 2023-10-30 21:54:11,824 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/526ff4dc05e245f6b022893c53701eab as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/526ff4dc05e245f6b022893c53701eab 2023-10-30 21:54:11,828 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/526ff4dc05e245f6b022893c53701eab, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 21:54:11,829 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c3a28ebc198b1a1c5b23a42f79c57432 in 829ms, sequenceid=13, compaction requested=true 2023-10-30 21:54:11,829 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:11,829 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:11,829 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:11,829 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:11,829 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,829 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:11,829 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:11,831 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,831 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:11,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:11,831 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,831 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:11,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:11,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:11,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:11,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:11,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f76b4bb[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:11,833 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:11,833 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,834 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,834 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:11,834 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:11,834 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:11,834 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,834 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:11,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:11,835 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:11,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:11,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:11,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:11,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:11,838 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:11,838 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:11,838 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:11,838 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,838 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:11,840 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,840 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,840 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:11,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:11,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:11,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:11,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:11,840 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:11,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:11,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,842 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:11,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:11,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:11,844 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:11,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:11,844 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:11,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:11,844 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,945 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:11,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:11,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:11,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:11,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,951 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:11,951 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:11,951 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:54:11,951 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:54:11,952 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,952 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,953 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,953 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:11,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:11,953 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:11,953 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,954 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,954 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:54:11,954 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:11,954 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:54:11,954 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:11,954 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:54:11,955 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:11,955 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:11,955 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:11,955 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. started... 2023-10-30 21:54:11,955 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3a28ebc198b1a1c5b23a42f79c57432 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:12,367 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053db7630c093b431881c71bcdd6425ad3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053db7630c093b431881c71bcdd6425ad3 2023-10-30 21:54:12,773 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/f9d3447a6223469cb8508637d8b67c02 2023-10-30 21:54:12,778 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/f9d3447a6223469cb8508637d8b67c02 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/f9d3447a6223469cb8508637d8b67c02 2023-10-30 21:54:12,782 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/f9d3447a6223469cb8508637d8b67c02, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 21:54:12,783 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c3a28ebc198b1a1c5b23a42f79c57432 in 828ms, sequenceid=17, compaction requested=true 2023-10-30 21:54:12,783 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:12,783 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:12,783 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:12,783 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:12,783 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,783 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:12,783 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:12,786 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,786 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:12,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:12,786 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,786 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:12,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:12,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:12,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:12,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:12,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65acdc11[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:12,787 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:12,787 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,789 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,790 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:12,790 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:12,790 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:12,790 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,790 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:12,791 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:12,791 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,791 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:12,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,791 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:12,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:12,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:12,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:12,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:12,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:12,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:12,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:12,794 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:12,794 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:12,794 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:12,794 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,794 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:12,796 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,796 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:12,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:12,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,796 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:12,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:12,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:12,797 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:12,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:12,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,798 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:12,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,800 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,800 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,801 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:12,801 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:12,801 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,801 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:12,801 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:12,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:12,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:12,801 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:12,801 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,801 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:12,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:12,801 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:12,801 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:12,901 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:12,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:12,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:12,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:12,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,909 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:12,909 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:12,909 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:54:12,909 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:54:12,909 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,909 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,912 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,912 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:12,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:12,912 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:12,912 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:12,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,913 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,913 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:54:12,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:12,913 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:54:12,913 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:12,913 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:54:12,914 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:12,914 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:12,914 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:12,914 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. started... 2023-10-30 21:54:12,914 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3a28ebc198b1a1c5b23a42f79c57432 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:13,328 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a6b8cbffd7234630b3328694d7044d64 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228a6b8cbffd7234630b3328694d7044d64 2023-10-30 21:54:13,733 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/16b468a9287f4f76bf826122b9d00990 2023-10-30 21:54:13,738 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/16b468a9287f4f76bf826122b9d00990 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/16b468a9287f4f76bf826122b9d00990 2023-10-30 21:54:13,742 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/16b468a9287f4f76bf826122b9d00990, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 21:54:13,743 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c3a28ebc198b1a1c5b23a42f79c57432 in 829ms, sequenceid=21, compaction requested=true 2023-10-30 21:54:13,743 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:13,743 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:13,743 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:13,743 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:13,743 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,743 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:13,743 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:13,748 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,748 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:13,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:13,748 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,748 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:13,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:13,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:13,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:13,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:13,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3abe6f02[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:13,749 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:13,749 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,751 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,751 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:13,751 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:13,751 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:13,751 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,751 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:13,753 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:13,753 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,753 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:13,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:13,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:13,753 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:13,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:13,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:13,755 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:13,755 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:13,755 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:13,755 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,755 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:13,757 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,757 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,757 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:13,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:13,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:13,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:13,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:13,757 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:13,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:13,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,758 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:13,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,761 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:13,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:13,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:13,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:54:13,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:13,761 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:13,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:13,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:13,861 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:13,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:13,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:13,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:13,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,868 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:13,868 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:13,868 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:54:13,868 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:54:13,869 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,869 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,870 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,870 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:13,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:13,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:13,870 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:13,870 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:13,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:13,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,871 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,871 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:54:13,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:13,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:54:13,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:13,871 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:54:13,872 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:13,872 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:13,872 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:13,872 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. started... 2023-10-30 21:54:13,872 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3a28ebc198b1a1c5b23a42f79c57432 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:14,284 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a9f26e180f4e408c8dcd372b979148b4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231a9f26e180f4e408c8dcd372b979148b4 2023-10-30 21:54:14,690 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/8ede64b7560c46538ecc9d003022c13e 2023-10-30 21:54:14,695 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/8ede64b7560c46538ecc9d003022c13e as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/8ede64b7560c46538ecc9d003022c13e 2023-10-30 21:54:14,699 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/8ede64b7560c46538ecc9d003022c13e, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 21:54:14,700 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c3a28ebc198b1a1c5b23a42f79c57432 in 828ms, sequenceid=25, compaction requested=true 2023-10-30 21:54:14,700 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:14,700 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:14,700 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:14,700 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:14,700 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,700 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:14,700 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:14,703 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,703 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:14,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:14,704 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:14,704 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:14,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:14,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:14,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:14,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c8e167b[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:14,705 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:14,705 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,706 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,707 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:14,707 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:14,707 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:14,707 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,707 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:14,708 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:14,708 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,708 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:14,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,708 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:14,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:14,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:14,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:14,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:14,711 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:14,711 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:14,711 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:14,711 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,711 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:14,712 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,712 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:14,712 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:14,713 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:14,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,714 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:14,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,717 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,717 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:14,717 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:14,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:14,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:54:14,717 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,717 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:14,717 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:14,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:14,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:14,717 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,718 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:14,718 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:14,718 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,718 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:14,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:14,718 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,818 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:14,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:14,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:14,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:14,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,824 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:14,824 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:14,824 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:54:14,824 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:54:14,825 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,825 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,827 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,827 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:14,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:14,827 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:14,827 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,828 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,828 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:14,828 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:54:14,828 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:14,828 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:54:14,828 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:14,828 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:14,828 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:14,828 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. started... 2023-10-30 21:54:14,828 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3a28ebc198b1a1c5b23a42f79c57432 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:15,247 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017736a465229b49fe8f3fa5dbba406f19 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601017736a465229b49fe8f3fa5dbba406f19 2023-10-30 21:54:15,653 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/14e0a61af86d4d589b1ab2cdc714fa34 2023-10-30 21:54:15,658 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/14e0a61af86d4d589b1ab2cdc714fa34 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/14e0a61af86d4d589b1ab2cdc714fa34 2023-10-30 21:54:15,662 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/14e0a61af86d4d589b1ab2cdc714fa34, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 21:54:15,662 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c3a28ebc198b1a1c5b23a42f79c57432 in 834ms, sequenceid=29, compaction requested=true 2023-10-30 21:54:15,663 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:15,663 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:15,663 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:15,663 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:15,663 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,663 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:15,663 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:15,665 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,665 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:15,665 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,665 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:15,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:15,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:15,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b7b83d[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:15,666 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:15,666 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,668 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,668 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:15,668 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:15,668 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:15,668 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,668 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:15,671 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:15,671 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:15,671 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,671 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:15,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:15,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:15,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:15,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:15,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:15,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:15,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:15,673 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:15,674 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:15,674 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:15,674 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,674 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:15,675 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,675 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:15,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:15,676 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:15,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,676 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:15,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:15,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:15,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:15,677 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:15,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,682 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,682 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,683 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,682 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:15,683 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:15,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:15,683 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,683 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,683 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:15,683 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:15,683 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:15,683 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:15,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:54:15,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:15,683 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:15,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:15,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:15,783 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:15,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:15,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:15,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:15,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,790 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:15,790 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:15,790 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:54:15,790 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:54:15,790 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,790 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,792 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,792 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:15,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:15,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:15,793 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:15,793 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:15,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:15,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,793 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,794 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:54:15,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:15,794 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:54:15,794 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:15,794 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:54:15,794 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:15,794 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:15,794 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:15,794 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. started... 2023-10-30 21:54:15,794 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3a28ebc198b1a1c5b23a42f79c57432 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:16,207 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cfe6ec43463944a9a8b3b421c8c1189b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103cfe6ec43463944a9a8b3b421c8c1189b 2023-10-30 21:54:16,612 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/6cad4435a97f4f7a910fcc6998682312 2023-10-30 21:54:16,617 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/6cad4435a97f4f7a910fcc6998682312 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6cad4435a97f4f7a910fcc6998682312 2023-10-30 21:54:16,621 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6cad4435a97f4f7a910fcc6998682312, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 21:54:16,622 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c3a28ebc198b1a1c5b23a42f79c57432 in 828ms, sequenceid=33, compaction requested=true 2023-10-30 21:54:16,622 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:16,622 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:16,622 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:16,622 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:16,622 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,622 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:16,622 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:16,624 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,624 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:16,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:16,625 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,625 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:16,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:16,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:16,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:16,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:16,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65f8acae[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:16,626 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:16,626 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,627 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,627 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:16,627 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:16,627 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:16,627 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,627 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:16,629 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,629 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:16,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:16,629 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:16,629 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:16,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:16,632 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:16,632 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:16,632 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:16,632 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,632 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:16,634 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,634 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,634 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:16,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:16,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:16,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:16,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:16,635 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:16,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:16,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,636 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:16,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:16,638 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:16,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:16,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:16,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:16,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:16,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:16,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:54:16,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,639 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:16,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:16,639 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:16,639 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:16,639 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,639 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,639 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,739 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:16,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:16,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:16,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:16,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,746 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:16,746 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:16,746 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:54:16,746 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:54:16,746 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,746 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,748 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:16,748 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:16,748 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:16,748 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,749 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,749 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:54:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:54:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:16,749 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:16,750 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. started... 2023-10-30 21:54:16,750 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3a28ebc198b1a1c5b23a42f79c57432 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:17,162 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090703d292b1276d42659063312e15061561 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090703d292b1276d42659063312e15061561 2023-10-30 21:54:17,567 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/b0e92e4e20694156a2ec8b4579f47402 2023-10-30 21:54:17,572 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/b0e92e4e20694156a2ec8b4579f47402 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/b0e92e4e20694156a2ec8b4579f47402 2023-10-30 21:54:17,576 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/b0e92e4e20694156a2ec8b4579f47402, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 21:54:17,577 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c3a28ebc198b1a1c5b23a42f79c57432 in 827ms, sequenceid=37, compaction requested=true 2023-10-30 21:54:17,577 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:17,577 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:17,577 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:17,577 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:17,577 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,577 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:17,577 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:17,579 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,579 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:17,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:17,579 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,579 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:17,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:17,581 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:17,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c77196c[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:17,581 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,583 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,583 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:17,583 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:17,583 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:17,583 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,583 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:17,584 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:17,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:17,586 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:17,586 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:17,586 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:17,586 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,586 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:17,588 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,588 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:17,588 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:17,588 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,589 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:17,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:17,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:17,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:17,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-30 21:54:17,592 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:17,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:17,592 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,693 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:17,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:17,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:17,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:17,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,699 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:17,699 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:17,699 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-30 21:54:17,699 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-30 21:54:17,700 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,700 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,702 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,702 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:17,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:17,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:17,702 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:17,702 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:17,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,703 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,703 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-30 21:54:17,703 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:17,703 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-30 21:54:17,703 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:17,703 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-30 21:54:17,703 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:17,703 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:17,703 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:17,704 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. started... 2023-10-30 21:54:17,704 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c3a28ebc198b1a1c5b23a42f79c57432 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:18,116 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120954f770ea5244e18894105cc272fd87a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120954f770ea5244e18894105cc272fd87a 2023-10-30 21:54:18,522 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/829521ce2a4f409684a7fb08e85a7ee5 2023-10-30 21:54:18,527 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/829521ce2a4f409684a7fb08e85a7ee5 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/829521ce2a4f409684a7fb08e85a7ee5 2023-10-30 21:54:18,531 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/829521ce2a4f409684a7fb08e85a7ee5, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 21:54:18,531 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c3a28ebc198b1a1c5b23a42f79c57432 in 827ms, sequenceid=41, compaction requested=true 2023-10-30 21:54:18,532 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:18,532 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:18,532 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:18,532 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:18,532 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,532 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-30 21:54:18,532 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-30 21:54:18,534 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,534 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:18,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:18,534 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,534 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:18,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:18,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:18,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:18,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-30 21:54:18,535 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-30 21:54:18,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50b6ef57[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:18,535 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,537 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,537 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-30 21:54:18,537 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-30 21:54:18,537 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:18,537 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,537 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:18,538 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,538 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-30 21:54:18,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:18,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:18,538 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:18,538 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-30 21:54:18,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:18,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:18,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:18,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:54:18,541 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-30 21:54:18,541 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:18,541 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:18,541 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,541 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:18,544 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,544 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,544 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:18,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:18,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:18,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:18,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:18,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:18,544 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:18,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,546 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,551 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,551 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:18,551 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:18,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-30 21:54:18,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:18,551 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:18,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:18,551 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:18,551 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,551 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:18,551 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,551 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,551 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:18,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:18,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:18,551 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,552 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:18,652 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:18,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:18,654 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-10-30 21:54:18,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:54:18,657 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:54:18,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:18,658 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703458658 2023-10-30 21:54:18,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:54:18,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-30 21:54:18,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:18,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x5ab4c46d to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:54:18,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c706d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:54:18,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:19,111 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fd6f986ade294c6baa28e4615d8ec346 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103fd6f986ade294c6baa28e4615d8ec346 2023-10-30 21:54:19,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:19,127 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:54:19,128 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:54:19,134 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:54:19,135 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:54:19,143 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a2ce4924567f4a338809b0a068f0f6d4 first=Optional[r3] last=Optional[r6] 2023-10-30 21:54:19,143 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a2ce4924567f4a338809b0a068f0f6d4}] 2023-10-30 21:54:19,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a2ce4924567f4a338809b0a068f0f6d4 for inclusion in c3a28ebc198b1a1c5b23a42f79c57432/family1 2023-10-30 21:54:19,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 21:54:19,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:19,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:19,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a2ce4924567f4a338809b0a068f0f6d4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cv595tf98m990cvd830if1fi7oevus6korujng22aul3e7e7dq5m3b55ouc3p5d2/family1/a2ce4924567f4a338809b0a068f0f6d4 2023-10-30 21:54:19,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cv595tf98m990cvd830if1fi7oevus6korujng22aul3e7e7dq5m3b55ouc3p5d2/family1/a2ce4924567f4a338809b0a068f0f6d4 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/ea9c83883ec84133add86bd937029371_SeqId_44_ 2023-10-30 21:54:19,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cv595tf98m990cvd830if1fi7oevus6korujng22aul3e7e7dq5m3b55ouc3p5d2/family1/a2ce4924567f4a338809b0a068f0f6d4 into c3a28ebc198b1a1c5b23a42f79c57432/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/ea9c83883ec84133add86bd937029371_SeqId_44_ - updating store file list. 2023-10-30 21:54:19,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/ea9c83883ec84133add86bd937029371_SeqId_44_ into c3a28ebc198b1a1c5b23a42f79c57432/family1 2023-10-30 21:54:19,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cv595tf98m990cvd830if1fi7oevus6korujng22aul3e7e7dq5m3b55ouc3p5d2/family1/a2ce4924567f4a338809b0a068f0f6d4 into c3a28ebc198b1a1c5b23a42f79c57432/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/ea9c83883ec84133add86bd937029371_SeqId_44_) 2023-10-30 21:54:19,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cv595tf98m990cvd830if1fi7oevus6korujng22aul3e7e7dq5m3b55ouc3p5d2/family1/a2ce4924567f4a338809b0a068f0f6d4 2023-10-30 21:54:19,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 21:54:19,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 21:54:19,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): c3a28ebc198b1a1c5b23a42f79c57432/family1 is initiating minor compaction 2023-10-30 21:54:19,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@52be82f6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:19,160 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c3a28ebc198b1a1c5b23a42f79c57432/family1 in testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:19,160 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5a389672cda94b50955e37752e078d92, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/526ff4dc05e245f6b022893c53701eab, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/f9d3447a6223469cb8508637d8b67c02, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/16b468a9287f4f76bf826122b9d00990, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/8ede64b7560c46538ecc9d003022c13e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/14e0a61af86d4d589b1ab2cdc714fa34, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6cad4435a97f4f7a910fcc6998682312, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/b0e92e4e20694156a2ec8b4579f47402, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/829521ce2a4f409684a7fb08e85a7ee5, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/ea9c83883ec84133add86bd937029371_SeqId_44_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp, totalSize=50.0 K 2023-10-30 21:54:19,160 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 5a389672cda94b50955e37752e078d92, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 21:54:19,160 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 526ff4dc05e245f6b022893c53701eab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 21:54:19,161 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting f9d3447a6223469cb8508637d8b67c02, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 21:54:19,161 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 16b468a9287f4f76bf826122b9d00990, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 21:54:19,161 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 8ede64b7560c46538ecc9d003022c13e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 21:54:19,161 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 14e0a61af86d4d589b1ab2cdc714fa34, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 21:54:19,161 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 6cad4435a97f4f7a910fcc6998682312, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 21:54:19,161 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting b0e92e4e20694156a2ec8b4579f47402, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 21:54:19,161 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 829521ce2a4f409684a7fb08e85a7ee5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 21:54:19,161 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting ea9c83883ec84133add86bd937029371_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 21:54:19,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:19,163 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:19,164 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228a6b8cbffd7234630b3328694d7044d64 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228a6b8cbffd7234630b3328694d7044d64 2023-10-30 21:54:19,166 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231a9f26e180f4e408c8dcd372b979148b4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231a9f26e180f4e408c8dcd372b979148b4 2023-10-30 21:54:19,167 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601017736a465229b49fe8f3fa5dbba406f19 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601017736a465229b49fe8f3fa5dbba406f19 2023-10-30 21:54:19,168 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103cfe6ec43463944a9a8b3b421c8c1189b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103cfe6ec43463944a9a8b3b421c8c1189b 2023-10-30 21:54:19,168 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-30 21:54:19,169 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 21:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:19,195 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): c3a28ebc198b1a1c5b23a42f79c57432#family1#compaction#49 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:54:20,010 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/a8c0d6654d4846cab872b8eac4f5e6be as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/a8c0d6654d4846cab872b8eac4f5e6be 2023-10-30 21:54:20,015 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c3a28ebc198b1a1c5b23a42f79c57432/family1 of c3a28ebc198b1a1c5b23a42f79c57432 into a8c0d6654d4846cab872b8eac4f5e6be(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:54:20,015 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:20,015 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698702859160; duration=0sec 2023-10-30 21:54:20,015 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:20,016 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dc964e3016a749f6822d4146e2dc29f9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205dc964e3016a749f6822d4146e2dc29f9 2023-10-30 21:54:20,017 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:20,040 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/df06363f6d0e4d76b431169d9dae9d5f first=Optional[r00] last=Optional[r2] 2023-10-30 21:54:20,041 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/df06363f6d0e4d76b431169d9dae9d5f}] 2023-10-30 21:54:20,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/df06363f6d0e4d76b431169d9dae9d5f for inclusion in c3a28ebc198b1a1c5b23a42f79c57432/family1 2023-10-30 21:54:20,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 21:54:20,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:20,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:20,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/df06363f6d0e4d76b431169d9dae9d5f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lep4fkpcemk4rppk7hgv15497n7v8n2q2bakd62fm1beocga4ioompr3jufui10o/family1/df06363f6d0e4d76b431169d9dae9d5f 2023-10-30 21:54:20,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lep4fkpcemk4rppk7hgv15497n7v8n2q2bakd62fm1beocga4ioompr3jufui10o/family1/df06363f6d0e4d76b431169d9dae9d5f as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6d42fdaf04cf4b3385bb35d641ba68e3_SeqId_47_ 2023-10-30 21:54:20,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lep4fkpcemk4rppk7hgv15497n7v8n2q2bakd62fm1beocga4ioompr3jufui10o/family1/df06363f6d0e4d76b431169d9dae9d5f into c3a28ebc198b1a1c5b23a42f79c57432/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6d42fdaf04cf4b3385bb35d641ba68e3_SeqId_47_ - updating store file list. 2023-10-30 21:54:20,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6d42fdaf04cf4b3385bb35d641ba68e3_SeqId_47_ into c3a28ebc198b1a1c5b23a42f79c57432/family1 2023-10-30 21:54:20,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lep4fkpcemk4rppk7hgv15497n7v8n2q2bakd62fm1beocga4ioompr3jufui10o/family1/df06363f6d0e4d76b431169d9dae9d5f into c3a28ebc198b1a1c5b23a42f79c57432/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6d42fdaf04cf4b3385bb35d641ba68e3_SeqId_47_) 2023-10-30 21:54:20,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyPolicy__lep4fkpcemk4rppk7hgv15497n7v8n2q2bakd62fm1beocga4ioompr3jufui10o/family1/df06363f6d0e4d76b431169d9dae9d5f 2023-10-30 21:54:20,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 21:54:20,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 21:54:20,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): c3a28ebc198b1a1c5b23a42f79c57432/family1 is initiating minor compaction (all files) 2023-10-30 21:54:20,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2d24fa77; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:20,055 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c3a28ebc198b1a1c5b23a42f79c57432/family1 in testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:54:20,055 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5dedd91e25cc4bc8b3ee7815f6c46075, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/a8c0d6654d4846cab872b8eac4f5e6be, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6d42fdaf04cf4b3385bb35d641ba68e3_SeqId_47_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp, totalSize=337.0 K 2023-10-30 21:54:20,056 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 5dedd91e25cc4bc8b3ee7815f6c46075, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822322 2023-10-30 21:54:20,057 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting a8c0d6654d4846cab872b8eac4f5e6be, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222322 2023-10-30 21:54:20,057 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 6d42fdaf04cf4b3385bb35d641ba68e3_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878822322 2023-10-30 21:54:20,059 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:20,060 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:20,061 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130e55b7f587ff443beb8cb32e9e5fcd31c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130e55b7f587ff443beb8cb32e9e5fcd31c 2023-10-30 21:54:20,064 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201941e12cc350944fcbc2379fd473454e1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201941e12cc350944fcbc2379fd473454e1 2023-10-30 21:54:20,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053db7630c093b431881c71bcdd6425ad3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053db7630c093b431881c71bcdd6425ad3 2023-10-30 21:54:20,065 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-10-30 21:54:20,065 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 21:54:20,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-30 21:54:20,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-30 21:54:20,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:20,067 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:54:20,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4120 sec 2023-10-30 21:54:20,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5a389672cda94b50955e37752e078d92, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/526ff4dc05e245f6b022893c53701eab, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/f9d3447a6223469cb8508637d8b67c02, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/16b468a9287f4f76bf826122b9d00990, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/8ede64b7560c46538ecc9d003022c13e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/14e0a61af86d4d589b1ab2cdc714fa34, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6cad4435a97f4f7a910fcc6998682312, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/b0e92e4e20694156a2ec8b4579f47402, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/829521ce2a4f409684a7fb08e85a7ee5, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/ea9c83883ec84133add86bd937029371_SeqId_44_] to archive 2023-10-30 21:54:20,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:20,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5a389672cda94b50955e37752e078d92 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5a389672cda94b50955e37752e078d92 2023-10-30 21:54:20,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/526ff4dc05e245f6b022893c53701eab to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/526ff4dc05e245f6b022893c53701eab 2023-10-30 21:54:20,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/f9d3447a6223469cb8508637d8b67c02 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/f9d3447a6223469cb8508637d8b67c02 2023-10-30 21:54:20,086 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): c3a28ebc198b1a1c5b23a42f79c57432#family1#compaction#50 average throughput is 8.14 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:54:20,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/16b468a9287f4f76bf826122b9d00990 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/16b468a9287f4f76bf826122b9d00990 2023-10-30 21:54:20,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/8ede64b7560c46538ecc9d003022c13e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/8ede64b7560c46538ecc9d003022c13e 2023-10-30 21:54:20,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/14e0a61af86d4d589b1ab2cdc714fa34 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/14e0a61af86d4d589b1ab2cdc714fa34 2023-10-30 21:54:20,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6cad4435a97f4f7a910fcc6998682312 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6cad4435a97f4f7a910fcc6998682312 2023-10-30 21:54:20,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/b0e92e4e20694156a2ec8b4579f47402 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/b0e92e4e20694156a2ec8b4579f47402 2023-10-30 21:54:20,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/829521ce2a4f409684a7fb08e85a7ee5 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/829521ce2a4f409684a7fb08e85a7ee5 2023-10-30 21:54:20,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/ea9c83883ec84133add86bd937029371_SeqId_44_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/ea9c83883ec84133add86bd937029371_SeqId_44_ 2023-10-30 21:54:20,118 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/.tmp/family1/fd293d1e1feb4f29b842f2b1a1d94ac5 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/fd293d1e1feb4f29b842f2b1a1d94ac5 2023-10-30 21:54:20,130 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c3a28ebc198b1a1c5b23a42f79c57432/family1 of c3a28ebc198b1a1c5b23a42f79c57432 into fd293d1e1feb4f29b842f2b1a1d94ac5(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:54:20,130 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:54:20,131 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1698702860055; duration=0sec 2023-10-30 21:54:20,131 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:20,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5dedd91e25cc4bc8b3ee7815f6c46075, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/a8c0d6654d4846cab872b8eac4f5e6be, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6d42fdaf04cf4b3385bb35d641ba68e3_SeqId_47_] to archive 2023-10-30 21:54:20,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:20,177 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249 (was 250), OpenFileDescriptor=611 (was 603) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=183 (was 235), ProcessCount=169 (was 169), AvailableMemoryMB=14972 (was 14979) 2023-10-30 21:54:20,181 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5dedd91e25cc4bc8b3ee7815f6c46075 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/5dedd91e25cc4bc8b3ee7815f6c46075 2023-10-30 21:54:20,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/a8c0d6654d4846cab872b8eac4f5e6be to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/a8c0d6654d4846cab872b8eac4f5e6be 2023-10-30 21:54:20,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6d42fdaf04cf4b3385bb35d641ba68e3_SeqId_47_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/family1/6d42fdaf04cf4b3385bb35d641ba68e3_SeqId_47_ 2023-10-30 21:54:20,189 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=249, OpenFileDescriptor=611, MaxFileDescriptor=60000, SystemLoadAverage=183, ProcessCount=169, AvailableMemoryMB=14972 2023-10-30 21:54:20,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 21:54:20,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:20,193 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:54:20,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-10-30 21:54:20,194 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:54:20,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 21:54:20,195 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:20,196 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de empty. 2023-10-30 21:54:20,196 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:20,196 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-10-30 21:54:20,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 21:54:20,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 21:54:20,605 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-30 21:54:20,606 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 80663ddf3580f76f31d5f9b2bc6708de, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:54:20,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 21:54:21,012 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:21,012 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 80663ddf3580f76f31d5f9b2bc6708de, disabling compactions & flushes 2023-10-30 21:54:21,012 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:21,012 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:21,012 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. after waiting 0 ms 2023-10-30 21:54:21,013 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:21,013 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:21,013 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:21,015 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:54:21,016 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702861016"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702861016"}]},"ts":"1698702861016"} 2023-10-30 21:54:21,017 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 21:54:21,018 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:54:21,018 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702861018"}]},"ts":"1698702861018"} 2023-10-30 21:54:21,019 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-10-30 21:54:21,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, ASSIGN}] 2023-10-30 21:54:21,024 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, ASSIGN 2023-10-30 21:54:21,025 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:54:21,176 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=80663ddf3580f76f31d5f9b2bc6708de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:21,176 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702861175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702861175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702861175"}]},"ts":"1698702861175"} 2023-10-30 21:54:21,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 80663ddf3580f76f31d5f9b2bc6708de, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:21,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 21:54:21,329 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:21,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:21,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80663ddf3580f76f31d5f9b2bc6708de, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:54:21,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:21,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:21,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:21,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:21,335 INFO [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:21,336 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:21,336 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:21,337 INFO [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80663ddf3580f76f31d5f9b2bc6708de columnFamilyName family1 2023-10-30 21:54:21,338 INFO [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(310): Store=80663ddf3580f76f31d5f9b2bc6708de/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:21,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:21,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:21,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:21,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:54:21,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80663ddf3580f76f31d5f9b2bc6708de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66081376, jitterRate=-0.01531076431274414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:54:21,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:21,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de., pid=41, masterSystemTime=1698702861329 2023-10-30 21:54:21,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:21,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:21,346 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=80663ddf3580f76f31d5f9b2bc6708de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:21,346 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702861346"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702861346"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702861346"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702861346"}]},"ts":"1698702861346"} 2023-10-30 21:54:21,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-10-30 21:54:21,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 80663ddf3580f76f31d5f9b2bc6708de, server=jenkins-hbase4.apache.org,44371,1698702798019 in 171 msec 2023-10-30 21:54:21,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-10-30 21:54:21,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, ASSIGN in 327 msec 2023-10-30 21:54:21,351 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:54:21,351 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702861351"}]},"ts":"1698702861351"} 2023-10-30 21:54:21,352 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-10-30 21:54:21,355 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:54:21,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1640 sec 2023-10-30 21:54:22,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-30 21:54:22,299 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-10-30 21:54:22,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:22,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:22,321 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:22,321 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:22,321 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 21:54:22,321 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 21:54:22,321 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:22,322 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:22,323 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:22,323 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:22,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:22,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:22,323 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:22,323 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:22,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:22,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:22,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:22,324 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:22,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:22,324 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 21:54:22,324 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:22,324 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 21:54:22,325 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:22,325 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:22,325 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:22,325 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. started... 2023-10-30 21:54:22,326 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80663ddf3580f76f31d5f9b2bc6708de 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 21:54:22,744 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c076172308914717b1045a66bceac190 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c076172308914717b1045a66bceac190 2023-10-30 21:54:23,148 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/af2a9f439b2a411a96b5660362ec67e3 2023-10-30 21:54:23,153 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/af2a9f439b2a411a96b5660362ec67e3 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2a9f439b2a411a96b5660362ec67e3 2023-10-30 21:54:23,157 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2a9f439b2a411a96b5660362ec67e3, entries=1000, sequenceid=5, filesize=191.4 K 2023-10-30 21:54:23,158 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 80663ddf3580f76f31d5f9b2bc6708de in 832ms, sequenceid=5, compaction requested=false 2023-10-30 21:54:23,158 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:23,159 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:23,159 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:23,159 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:23,159 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:23,159 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,159 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 21:54:23,159 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 21:54:23,161 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,161 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:23,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:23,161 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,161 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:23,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 21:54:23,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b1bd32c[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:23,163 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 21:54:23,163 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,165 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,165 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 21:54:23,165 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 21:54:23,165 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,165 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:23,165 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:23,167 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,167 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 21:54:23,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:23,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:23,167 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:23,167 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 21:54:23,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:23,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:23,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:23,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:23,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 21:54:23,169 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 21:54:23,169 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:23,169 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:23,169 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,169 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:23,172 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,172 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:23,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:23,172 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:23,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:23,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:23,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:23,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,173 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:23,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,174 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:23,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,176 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:23,176 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:23,176 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:23,176 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:23,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 21:54:23,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:23,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:23,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:23,176 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,177 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,177 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,177 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,177 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,177 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:23,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:23,177 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:23,177 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:23,277 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:23,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:23,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:23,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:23,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,284 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:23,284 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:23,284 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 21:54:23,284 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 21:54:23,284 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,284 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,286 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:23,286 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:23,286 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,286 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:23,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,287 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,287 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 21:54:23,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,287 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 21:54:23,287 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:23,287 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 21:54:23,287 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:23,287 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:23,287 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:23,287 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. started... 2023-10-30 21:54:23,288 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80663ddf3580f76f31d5f9b2bc6708de 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 21:54:23,701 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287993ce088ea245cc8a63f76d5878bbf3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287993ce088ea245cc8a63f76d5878bbf3 2023-10-30 21:54:23,706 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/d8dfeb911cc94bb197346424d3a3a329 2023-10-30 21:54:23,712 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/d8dfeb911cc94bb197346424d3a3a329 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d8dfeb911cc94bb197346424d3a3a329 2023-10-30 21:54:23,716 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d8dfeb911cc94bb197346424d3a3a329, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 21:54:23,717 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 80663ddf3580f76f31d5f9b2bc6708de in 429ms, sequenceid=9, compaction requested=false 2023-10-30 21:54:23,717 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:23,717 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:23,717 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:23,717 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:23,717 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,718 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 21:54:23,718 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 21:54:23,719 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,719 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:23,720 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,720 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:23,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:23,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:23,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 21:54:23,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b26933d[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:23,722 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 21:54:23,722 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,724 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,724 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 21:54:23,724 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 21:54:23,724 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:23,724 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,724 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:23,726 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,726 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 21:54:23,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:23,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:23,726 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:23,726 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 21:54:23,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:23,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:23,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:23,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:23,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 21:54:23,729 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 21:54:23,729 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:23,729 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:23,729 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,729 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:23,730 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,730 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:23,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,731 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:23,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:23,731 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,732 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,738 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,738 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:23,738 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:23,738 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:23,738 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:23,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:23,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:23,738 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,738 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,738 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,738 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,738 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,739 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:23,739 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:23,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:23,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:23,839 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:23,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:23,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:23,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:23,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,845 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:23,845 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:23,845 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 21:54:23,845 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 21:54:23,845 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,846 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,847 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,847 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:23,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:23,847 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:23,847 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:23,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,848 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,848 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 21:54:23,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 21:54:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 21:54:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:23,848 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:23,849 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:23,849 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. started... 2023-10-30 21:54:23,849 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80663ddf3580f76f31d5f9b2bc6708de 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:24,263 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120118cbde8305bb4636ae1b588844b4c4c0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120118cbde8305bb4636ae1b588844b4c4c0 2023-10-30 21:54:24,668 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/7b55f661823c440eb2de4e54ffb36792 2023-10-30 21:54:24,673 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/7b55f661823c440eb2de4e54ffb36792 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/7b55f661823c440eb2de4e54ffb36792 2023-10-30 21:54:24,676 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/7b55f661823c440eb2de4e54ffb36792, entries=1, sequenceid=13, filesize=5.0 K 2023-10-30 21:54:24,677 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 80663ddf3580f76f31d5f9b2bc6708de in 828ms, sequenceid=13, compaction requested=true 2023-10-30 21:54:24,677 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:24,677 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:24,677 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:24,677 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:24,677 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,677 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 21:54:24,677 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 21:54:24,680 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,680 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:24,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:24,681 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,681 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:24,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:24,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 21:54:24,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f0e434c[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:24,682 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 21:54:24,682 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,683 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,683 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 21:54:24,684 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 21:54:24,684 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:24,684 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,684 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:24,686 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,686 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 21:54:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:24,686 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:24,686 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 21:54:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:24,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 21:54:24,688 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 21:54:24,688 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:24,688 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:24,688 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,688 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:24,690 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,690 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:24,690 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:24,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:24,690 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:24,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,691 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:24,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,694 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,694 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,694 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:24,694 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:24,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:24,694 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,694 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:24,694 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:24,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:24,694 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:24,694 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:24,694 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,695 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:24,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:24,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:24,695 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,795 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:24,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:24,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:24,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:24,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,802 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:24,802 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:24,802 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 21:54:24,802 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 21:54:24,802 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,802 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,803 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:24,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:24,804 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:24,804 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:24,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,804 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:24,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:24,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,805 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,805 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 21:54:24,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:24,805 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 21:54:24,805 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:24,805 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 21:54:24,805 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:24,805 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:24,805 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. started... 2023-10-30 21:54:24,805 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:24,806 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80663ddf3580f76f31d5f9b2bc6708de 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:25,219 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058882d198545b4904a058ce34e633845b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512058882d198545b4904a058ce34e633845b 2023-10-30 21:54:25,625 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/a952306ee66e4573a82b1371e474718f 2023-10-30 21:54:25,629 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/a952306ee66e4573a82b1371e474718f as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/a952306ee66e4573a82b1371e474718f 2023-10-30 21:54:25,633 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/a952306ee66e4573a82b1371e474718f, entries=1, sequenceid=17, filesize=5.0 K 2023-10-30 21:54:25,634 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 80663ddf3580f76f31d5f9b2bc6708de in 828ms, sequenceid=17, compaction requested=true 2023-10-30 21:54:25,634 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:25,634 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 21:54:25,634 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 21:54:25,636 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:25,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 21:54:25,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58a5dfad[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:25,637 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 21:54:25,637 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,639 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 21:54:25,639 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 21:54:25,639 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:25,639 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,639 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:25,641 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,641 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 21:54:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:25,641 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:25,641 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 21:54:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:25,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 21:54:25,643 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 21:54:25,643 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:25,643 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:25,643 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,643 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:25,645 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,645 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,645 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:25,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:25,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:25,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:25,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:25,645 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:25,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:25,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,647 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:25,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,648 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,649 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,649 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,649 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,649 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:25,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:25,649 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,649 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:25,649 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,649 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:25,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 21:54:25,649 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:25,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:25,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:25,649 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:25,649 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:25,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:25,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:25,749 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:25,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:25,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:25,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:25,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,756 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:25,756 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:25,756 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 21:54:25,756 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 21:54:25,756 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,756 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,757 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:25,757 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:25,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:25,758 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:25,758 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:25,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:25,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,758 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,759 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 21:54:25,759 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:25,759 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 21:54:25,759 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:25,759 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 21:54:25,759 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:25,759 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:25,759 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:25,759 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. started... 2023-10-30 21:54:25,759 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80663ddf3580f76f31d5f9b2bc6708de 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:26,171 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ceb4656ebdab49a7885b0a5a051e4855 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ceb4656ebdab49a7885b0a5a051e4855 2023-10-30 21:54:26,577 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/86ea6d83ee9f4bae971927471aa7afb3 2023-10-30 21:54:26,582 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/86ea6d83ee9f4bae971927471aa7afb3 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/86ea6d83ee9f4bae971927471aa7afb3 2023-10-30 21:54:26,586 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/86ea6d83ee9f4bae971927471aa7afb3, entries=1, sequenceid=21, filesize=5.0 K 2023-10-30 21:54:26,587 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 80663ddf3580f76f31d5f9b2bc6708de in 828ms, sequenceid=21, compaction requested=true 2023-10-30 21:54:26,587 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:26,587 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 21:54:26,587 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 21:54:26,592 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,592 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:26,592 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,592 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:26,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:26,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 21:54:26,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@df2e526[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:26,594 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 21:54:26,594 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,595 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,595 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 21:54:26,595 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 21:54:26,595 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,595 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:26,595 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:26,596 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 21:54:26,596 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,596 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:26,596 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 21:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:26,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:26,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 21:54:26,599 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 21:54:26,599 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:26,599 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:26,599 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,599 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:26,601 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,601 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:26,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,601 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:26,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:26,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:26,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:26,603 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:26,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,604 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,606 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,606 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:26,606 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:26,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:26,606 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:26,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:26,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:26,607 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,607 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:26,607 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:26,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:26,607 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,607 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,607 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:26,607 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:26,607 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,707 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:26,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:26,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:26,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:26,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,713 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:26,714 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:26,714 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 21:54:26,714 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 21:54:26,714 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,714 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,715 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,715 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:26,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:26,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:26,715 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:26,715 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:26,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:26,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,716 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,716 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 21:54:26,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:26,716 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 21:54:26,717 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:26,717 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 21:54:26,717 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:26,717 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:26,717 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:26,717 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. started... 2023-10-30 21:54:26,717 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80663ddf3580f76f31d5f9b2bc6708de 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:26,862 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:54:27,129 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314491b83e30a14f6bbde71d4544382d6d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512314491b83e30a14f6bbde71d4544382d6d 2023-10-30 21:54:27,536 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/1a75b62904b74812898d1fc278e1accc 2023-10-30 21:54:27,540 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/1a75b62904b74812898d1fc278e1accc as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/1a75b62904b74812898d1fc278e1accc 2023-10-30 21:54:27,544 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/1a75b62904b74812898d1fc278e1accc, entries=1, sequenceid=25, filesize=5.0 K 2023-10-30 21:54:27,545 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 80663ddf3580f76f31d5f9b2bc6708de in 828ms, sequenceid=25, compaction requested=true 2023-10-30 21:54:27,545 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:27,545 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 21:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 21:54:27,547 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,547 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:27,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:27,547 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,547 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:27,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:27,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 21:54:27,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12d230de[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:27,548 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 21:54:27,549 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,553 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,553 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 21:54:27,553 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 21:54:27,553 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:27,553 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,553 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:27,555 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 21:54:27,555 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:27,555 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,555 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 21:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:27,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 21:54:27,557 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 21:54:27,557 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:27,557 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:27,557 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,558 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:27,559 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,559 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:27,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,559 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:27,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:27,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:27,560 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:27,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:27,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,561 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:27,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,563 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,563 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:27,563 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:27,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:27,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:27,563 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:27,563 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,563 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:27,563 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:27,564 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:27,564 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,564 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:27,564 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,564 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:27,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:27,664 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:27,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:27,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:27,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:27,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,670 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:27,670 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:27,670 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 21:54:27,670 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 21:54:27,671 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,671 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,673 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,673 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:27,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:27,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:27,673 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:27,673 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:27,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:27,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,674 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,674 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 21:54:27,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 21:54:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:27,674 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 21:54:27,675 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:27,675 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:27,675 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:27,675 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. started... 2023-10-30 21:54:27,675 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80663ddf3580f76f31d5f9b2bc6708de 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:28,087 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101772d30a3550e4ba180bff3d7b9c2ccd7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101772d30a3550e4ba180bff3d7b9c2ccd7 2023-10-30 21:54:28,493 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/881b6ca167cf44bd8a50066f0a3f5e8d 2023-10-30 21:54:28,498 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/881b6ca167cf44bd8a50066f0a3f5e8d as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/881b6ca167cf44bd8a50066f0a3f5e8d 2023-10-30 21:54:28,502 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/881b6ca167cf44bd8a50066f0a3f5e8d, entries=1, sequenceid=29, filesize=5.0 K 2023-10-30 21:54:28,503 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 80663ddf3580f76f31d5f9b2bc6708de in 828ms, sequenceid=29, compaction requested=true 2023-10-30 21:54:28,503 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:28,503 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:28,503 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:28,503 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:28,503 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,503 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 21:54:28,503 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 21:54:28,505 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,505 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:28,506 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,506 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:28,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 21:54:28,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f8b05eb[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:28,507 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 21:54:28,507 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,509 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,509 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 21:54:28,509 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 21:54:28,509 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:28,509 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,509 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:28,510 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,510 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 21:54:28,510 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:28,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:28,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:28,510 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 21:54:28,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:28,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:28,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:28,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 21:54:28,513 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 21:54:28,513 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:28,513 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:28,513 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,513 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:28,518 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,518 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:28,518 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:28,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:28,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:28,519 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:28,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,520 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:28,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,522 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,522 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:28,522 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:28,522 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:28,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:28,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:28,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:28,522 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,522 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:28,523 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,523 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,523 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:28,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:28,523 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,523 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:28,523 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:28,623 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:28,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:28,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:28,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:28,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,629 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:28,629 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:28,629 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 21:54:28,629 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 21:54:28,630 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,630 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,631 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,631 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:28,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:28,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:28,631 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:28,631 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:28,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:28,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,632 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,632 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 21:54:28,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:28,632 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 21:54:28,632 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:28,632 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 21:54:28,632 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:28,632 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:28,632 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:28,632 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. started... 2023-10-30 21:54:28,633 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80663ddf3580f76f31d5f9b2bc6708de 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:29,047 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010375412a60b9bf46a8a6ef2ef9c2148fad to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010375412a60b9bf46a8a6ef2ef9c2148fad 2023-10-30 21:54:29,452 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/d7ca44bc2a0a40baae5a8c0f4dcbe55b 2023-10-30 21:54:29,457 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/d7ca44bc2a0a40baae5a8c0f4dcbe55b as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d7ca44bc2a0a40baae5a8c0f4dcbe55b 2023-10-30 21:54:29,461 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d7ca44bc2a0a40baae5a8c0f4dcbe55b, entries=1, sequenceid=33, filesize=5.0 K 2023-10-30 21:54:29,461 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 80663ddf3580f76f31d5f9b2bc6708de in 828ms, sequenceid=33, compaction requested=true 2023-10-30 21:54:29,461 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:29,462 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 21:54:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 21:54:29,464 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,464 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:29,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:29,465 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,465 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:29,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:29,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:29,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:29,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 21:54:29,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29a5e100[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:29,466 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 21:54:29,466 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,467 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,468 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 21:54:29,468 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 21:54:29,468 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,468 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:29,468 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:29,469 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 21:54:29,469 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:29,469 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,469 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 21:54:29,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:29,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:29,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:29,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:29,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 21:54:29,471 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 21:54:29,471 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:29,471 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:29,471 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,471 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:29,473 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,473 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:29,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,473 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:29,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:29,473 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:29,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,474 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,478 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,478 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:29,478 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:29,478 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:29,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:29,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:29,478 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,478 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:29,478 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:29,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:29,478 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,478 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:29,479 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:29,478 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,479 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,579 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:29,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:29,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:29,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:29,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,585 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:29,585 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:29,585 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 21:54:29,585 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 21:54:29,586 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,586 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,587 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,587 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:29,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:29,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:29,587 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:29,587 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:29,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:29,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,588 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,588 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 21:54:29,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:29,588 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 21:54:29,588 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:29,588 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 21:54:29,588 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:29,588 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:29,589 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:29,589 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. started... 2023-10-30 21:54:29,589 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80663ddf3580f76f31d5f9b2bc6708de 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:30,001 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a6dcdf683f7e4033876c19b5c6fa224a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907a6dcdf683f7e4033876c19b5c6fa224a 2023-10-30 21:54:30,406 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/b9da78f0606e4f13b36cbbbf344cada2 2023-10-30 21:54:30,411 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/b9da78f0606e4f13b36cbbbf344cada2 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/b9da78f0606e4f13b36cbbbf344cada2 2023-10-30 21:54:30,415 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/b9da78f0606e4f13b36cbbbf344cada2, entries=1, sequenceid=37, filesize=5.0 K 2023-10-30 21:54:30,416 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 80663ddf3580f76f31d5f9b2bc6708de in 827ms, sequenceid=37, compaction requested=true 2023-10-30 21:54:30,416 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:30,416 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 21:54:30,416 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 21:54:30,418 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,418 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:30,418 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,418 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 21:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3364eac7[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:30,419 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 21:54:30,419 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,420 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 21:54:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 21:54:30,421 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:30,421 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,421 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:30,423 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 21:54:30,423 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:30,423 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,423 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 21:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:30,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 21:54:30,425 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 21:54:30,425 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:30,425 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:30,425 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,425 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:30,427 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,427 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:30,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,427 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:30,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:30,428 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,429 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:30,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,434 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,434 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,434 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,434 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:30,434 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:30,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:30,435 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,435 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:30,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:30,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:30,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 21:54:30,435 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,435 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,435 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:30,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:30,435 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:30,435 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:30,535 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:30,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:30,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:30,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:30,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,542 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:30,542 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:30,542 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-30 21:54:30,542 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-30 21:54:30,542 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,542 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,543 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:30,543 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:30,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:30,544 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:30,544 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:30,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,545 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-30 21:54:30,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:30,545 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-30 21:54:30,545 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:30,545 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-30 21:54:30,545 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:30,545 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:30,545 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:30,545 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. started... 2023-10-30 21:54:30,545 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 80663ddf3580f76f31d5f9b2bc6708de 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:30,957 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112068e91ccfe693419e96697e10901d15eb to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112068e91ccfe693419e96697e10901d15eb 2023-10-30 21:54:31,363 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/45817d69709649b08211dbbe655270d7 2023-10-30 21:54:31,367 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/45817d69709649b08211dbbe655270d7 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/45817d69709649b08211dbbe655270d7 2023-10-30 21:54:31,371 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/45817d69709649b08211dbbe655270d7, entries=1, sequenceid=41, filesize=5.0 K 2023-10-30 21:54:31,372 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 80663ddf3580f76f31d5f9b2bc6708de in 827ms, sequenceid=41, compaction requested=true 2023-10-30 21:54:31,372 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:31,372 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:31,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:31,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:31,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-30 21:54:31,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-30 21:54:31,374 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,374 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:31,374 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,374 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:31,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-30 21:54:31,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30b378b5[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:31,376 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-30 21:54:31,376 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,378 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-30 21:54:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-30 21:54:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:31,378 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,378 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-30 21:54:31,380 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-30 21:54:31,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:31,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:31,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-30 21:54:31,382 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-30 21:54:31,382 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:31,383 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:31,383 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,383 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:31,384 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,384 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:31,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,384 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:31,385 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:31,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,390 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:31,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:31,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:31,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,393 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:31,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:31,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:31,393 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:31,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:31,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:31,493 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:31,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:31,495 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:31,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 21:54:31,498 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 21:54:31,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:31,498 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703471498 2023-10-30 21:54:31,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:54:31,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-30 21:54:31,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:31,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x5f891870 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:54:31,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38d72252, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:54:31,508 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:32,345 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103002e73b2086f44c29c96e7981a5e56ec to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103002e73b2086f44c29c96e7981a5e56ec 2023-10-30 21:54:32,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:32,359 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:54:32,360 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:54:32,366 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:54:32,368 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:54:32,376 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6b7e2120b6cd4866abfa08aaf55c8bfa first=Optional[r3] last=Optional[r6] 2023-10-30 21:54:32,376 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6b7e2120b6cd4866abfa08aaf55c8bfa}] 2023-10-30 21:54:32,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6b7e2120b6cd4866abfa08aaf55c8bfa for inclusion in 80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:32,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 21:54:32,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:32,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:32,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6b7e2120b6cd4866abfa08aaf55c8bfa to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__90pq42ij68m0kgjhuaoeqaaev1te8i68j00ipkbeva3ja9e2qscgqglint9e24k0/family1/6b7e2120b6cd4866abfa08aaf55c8bfa 2023-10-30 21:54:32,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__90pq42ij68m0kgjhuaoeqaaev1te8i68j00ipkbeva3ja9e2qscgqglint9e24k0/family1/6b7e2120b6cd4866abfa08aaf55c8bfa as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/dee732509b0b4d7a982ad4f5b12417b8_SeqId_44_ 2023-10-30 21:54:32,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__90pq42ij68m0kgjhuaoeqaaev1te8i68j00ipkbeva3ja9e2qscgqglint9e24k0/family1/6b7e2120b6cd4866abfa08aaf55c8bfa into 80663ddf3580f76f31d5f9b2bc6708de/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/dee732509b0b4d7a982ad4f5b12417b8_SeqId_44_ - updating store file list. 2023-10-30 21:54:32,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/dee732509b0b4d7a982ad4f5b12417b8_SeqId_44_ into 80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:32,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__90pq42ij68m0kgjhuaoeqaaev1te8i68j00ipkbeva3ja9e2qscgqglint9e24k0/family1/6b7e2120b6cd4866abfa08aaf55c8bfa into 80663ddf3580f76f31d5f9b2bc6708de/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/dee732509b0b4d7a982ad4f5b12417b8_SeqId_44_) 2023-10-30 21:54:32,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__90pq42ij68m0kgjhuaoeqaaev1te8i68j00ipkbeva3ja9e2qscgqglint9e24k0/family1/6b7e2120b6cd4866abfa08aaf55c8bfa 2023-10-30 21:54:32,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 21:54:32,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 21:54:32,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 80663ddf3580f76f31d5f9b2bc6708de/family1 is initiating minor compaction 2023-10-30 21:54:32,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@d8c46b5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:32,394 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 80663ddf3580f76f31d5f9b2bc6708de/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:32,394 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d8dfeb911cc94bb197346424d3a3a329, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/7b55f661823c440eb2de4e54ffb36792, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/a952306ee66e4573a82b1371e474718f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/86ea6d83ee9f4bae971927471aa7afb3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/1a75b62904b74812898d1fc278e1accc, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/881b6ca167cf44bd8a50066f0a3f5e8d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d7ca44bc2a0a40baae5a8c0f4dcbe55b, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/b9da78f0606e4f13b36cbbbf344cada2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/45817d69709649b08211dbbe655270d7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/dee732509b0b4d7a982ad4f5b12417b8_SeqId_44_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp, totalSize=50.4 K 2023-10-30 21:54:32,394 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting d8dfeb911cc94bb197346424d3a3a329, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 21:54:32,394 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 7b55f661823c440eb2de4e54ffb36792, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 21:54:32,394 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting a952306ee66e4573a82b1371e474718f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 21:54:32,394 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 86ea6d83ee9f4bae971927471aa7afb3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 21:54:32,394 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 1a75b62904b74812898d1fc278e1accc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 21:54:32,394 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 881b6ca167cf44bd8a50066f0a3f5e8d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 21:54:32,394 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting d7ca44bc2a0a40baae5a8c0f4dcbe55b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 21:54:32,394 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting b9da78f0606e4f13b36cbbbf344cada2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 21:54:32,394 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 45817d69709649b08211dbbe655270d7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 21:54:32,394 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting dee732509b0b4d7a982ad4f5b12417b8_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 21:54:32,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:32,396 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:32,398 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ceb4656ebdab49a7885b0a5a051e4855 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ceb4656ebdab49a7885b0a5a051e4855 2023-10-30 21:54:32,399 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512314491b83e30a14f6bbde71d4544382d6d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512314491b83e30a14f6bbde71d4544382d6d 2023-10-30 21:54:32,400 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101772d30a3550e4ba180bff3d7b9c2ccd7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101772d30a3550e4ba180bff3d7b9c2ccd7 2023-10-30 21:54:32,402 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010375412a60b9bf46a8a6ef2ef9c2148fad to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010375412a60b9bf46a8a6ef2ef9c2148fad 2023-10-30 21:54:32,402 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-10-30 21:54:32,402 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 21:54:32,402 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:32,402 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:32,402 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:32,402 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:32,403 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:32,403 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:32,403 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:32,403 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:32,433 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 80663ddf3580f76f31d5f9b2bc6708de#family1#compaction#61 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:54:32,455 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c0bcbf289d5c4d5ead3763790fd72264 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205c0bcbf289d5c4d5ead3763790fd72264 2023-10-30 21:54:32,456 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:32,483 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/906b94b63d1c4ea79c569cf71f44c815 first=Optional[r00] last=Optional[r2] 2023-10-30 21:54:32,484 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/906b94b63d1c4ea79c569cf71f44c815}] 2023-10-30 21:54:32,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/906b94b63d1c4ea79c569cf71f44c815 for inclusion in 80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:32,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 21:54:32,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:32,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:32,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/906b94b63d1c4ea79c569cf71f44c815 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2nbihmmrbaalkk5tr3ccsi6k5f5ns5v02np4oul3ttghe878p857g6l3c73enrsv/family1/906b94b63d1c4ea79c569cf71f44c815 2023-10-30 21:54:32,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2nbihmmrbaalkk5tr3ccsi6k5f5ns5v02np4oul3ttghe878p857g6l3c73enrsv/family1/906b94b63d1c4ea79c569cf71f44c815 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/0537c43ece66432ab104e840ac7f1b2e_SeqId_46_ 2023-10-30 21:54:32,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2nbihmmrbaalkk5tr3ccsi6k5f5ns5v02np4oul3ttghe878p857g6l3c73enrsv/family1/906b94b63d1c4ea79c569cf71f44c815 into 80663ddf3580f76f31d5f9b2bc6708de/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/0537c43ece66432ab104e840ac7f1b2e_SeqId_46_ - updating store file list. 2023-10-30 21:54:32,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/0537c43ece66432ab104e840ac7f1b2e_SeqId_46_ into 80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:32,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2nbihmmrbaalkk5tr3ccsi6k5f5ns5v02np4oul3ttghe878p857g6l3c73enrsv/family1/906b94b63d1c4ea79c569cf71f44c815 into 80663ddf3580f76f31d5f9b2bc6708de/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/0537c43ece66432ab104e840ac7f1b2e_SeqId_46_) 2023-10-30 21:54:32,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2nbihmmrbaalkk5tr3ccsi6k5f5ns5v02np4oul3ttghe878p857g6l3c73enrsv/family1/906b94b63d1c4ea79c569cf71f44c815 2023-10-30 21:54:32,497 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:32,498 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:32,499 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c076172308914717b1045a66bceac190 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130c076172308914717b1045a66bceac190 2023-10-30 21:54:32,500 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120118cbde8305bb4636ae1b588844b4c4c0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120118cbde8305bb4636ae1b588844b4c4c0 2023-10-30 21:54:32,501 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512058882d198545b4904a058ce34e633845b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512058882d198545b4904a058ce34e633845b 2023-10-30 21:54:32,501 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-10-30 21:54:32,501 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 21:54:32,502 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:32,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:32,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:32,503 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 21:54:32,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.0070 sec 2023-10-30 21:54:32,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 21:54:32,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:32,996 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-30 21:54:32,997 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-30 21:54:32,997 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-30 21:54:32,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-30 21:54:33,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, REOPEN/MOVE}] 2023-10-30 21:54:33,002 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, REOPEN/MOVE 2023-10-30 21:54:33,002 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=80663ddf3580f76f31d5f9b2bc6708de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:33,003 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702873002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702873002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702873002"}]},"ts":"1698702873002"} 2023-10-30 21:54:33,004 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33927] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=CLOSING, location=jenkins-hbase4.apache.org,44371,1698702798019, table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-10-30 21:54:33,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 80663ddf3580f76f31d5f9b2bc6708de, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:33,155 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:33,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:33,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80663ddf3580f76f31d5f9b2bc6708de, disabling compactions & flushes 2023-10-30 21:54:33,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:33,248 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/19f452f4aa8a4a31834a50704a72339b as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/19f452f4aa8a4a31834a50704a72339b 2023-10-30 21:54:33,252 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 80663ddf3580f76f31d5f9b2bc6708de/family1 of 80663ddf3580f76f31d5f9b2bc6708de into 19f452f4aa8a4a31834a50704a72339b(size=6.8 K), total size for store is 390.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:54:33,252 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:33,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:33,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:33,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. after waiting 0 ms 2023-10-30 21:54:33,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:33,253 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698702872394; duration=0sec 2023-10-30 21:54:33,253 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:33,261 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d8dfeb911cc94bb197346424d3a3a329, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/7b55f661823c440eb2de4e54ffb36792, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/a952306ee66e4573a82b1371e474718f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/86ea6d83ee9f4bae971927471aa7afb3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/1a75b62904b74812898d1fc278e1accc, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/881b6ca167cf44bd8a50066f0a3f5e8d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d7ca44bc2a0a40baae5a8c0f4dcbe55b, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/b9da78f0606e4f13b36cbbbf344cada2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/45817d69709649b08211dbbe655270d7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/dee732509b0b4d7a982ad4f5b12417b8_SeqId_44_] to archive 2023-10-30 21:54:33,262 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:33,263 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d8dfeb911cc94bb197346424d3a3a329 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d8dfeb911cc94bb197346424d3a3a329 2023-10-30 21:54:33,265 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/7b55f661823c440eb2de4e54ffb36792 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/7b55f661823c440eb2de4e54ffb36792 2023-10-30 21:54:33,266 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/a952306ee66e4573a82b1371e474718f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/a952306ee66e4573a82b1371e474718f 2023-10-30 21:54:33,267 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/86ea6d83ee9f4bae971927471aa7afb3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/86ea6d83ee9f4bae971927471aa7afb3 2023-10-30 21:54:33,268 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/1a75b62904b74812898d1fc278e1accc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/1a75b62904b74812898d1fc278e1accc 2023-10-30 21:54:33,269 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/881b6ca167cf44bd8a50066f0a3f5e8d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/881b6ca167cf44bd8a50066f0a3f5e8d 2023-10-30 21:54:33,270 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d7ca44bc2a0a40baae5a8c0f4dcbe55b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/d7ca44bc2a0a40baae5a8c0f4dcbe55b 2023-10-30 21:54:33,271 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/b9da78f0606e4f13b36cbbbf344cada2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/b9da78f0606e4f13b36cbbbf344cada2 2023-10-30 21:54:33,272 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/45817d69709649b08211dbbe655270d7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/45817d69709649b08211dbbe655270d7 2023-10-30 21:54:33,273 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/dee732509b0b4d7a982ad4f5b12417b8_SeqId_44_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/dee732509b0b4d7a982ad4f5b12417b8_SeqId_44_ 2023-10-30 21:54:33,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-10-30 21:54:33,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:33,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:33,278 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 80663ddf3580f76f31d5f9b2bc6708de to self. 2023-10-30 21:54:33,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:33,280 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=80663ddf3580f76f31d5f9b2bc6708de, regionState=CLOSED 2023-10-30 21:54:33,280 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702873280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702873280"}]},"ts":"1698702873280"} 2023-10-30 21:54:33,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-10-30 21:54:33,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 80663ddf3580f76f31d5f9b2bc6708de, server=jenkins-hbase4.apache.org,44371,1698702798019 in 277 msec 2023-10-30 21:54:33,283 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=true 2023-10-30 21:54:33,433 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=80663ddf3580f76f31d5f9b2bc6708de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:33,433 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702873433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702873433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702873433"}]},"ts":"1698702873433"} 2023-10-30 21:54:33,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 80663ddf3580f76f31d5f9b2bc6708de, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:33,587 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:33,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:33,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80663ddf3580f76f31d5f9b2bc6708de, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:54:33,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:33,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:33,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:33,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:33,591 INFO [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:33,592 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:33,592 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:33,592 INFO [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80663ddf3580f76f31d5f9b2bc6708de columnFamilyName family1 2023-10-30 21:54:33,597 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/0537c43ece66432ab104e840ac7f1b2e_SeqId_46_ 2023-10-30 21:54:33,601 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/19f452f4aa8a4a31834a50704a72339b 2023-10-30 21:54:33,604 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2a9f439b2a411a96b5660362ec67e3 2023-10-30 21:54:33,604 INFO [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(310): Store=80663ddf3580f76f31d5f9b2bc6708de/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:33,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:33,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:33,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:33,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80663ddf3580f76f31d5f9b2bc6708de; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73151208, jitterRate=0.09003794193267822}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:54:33,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:33,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de., pid=47, masterSystemTime=1698702873587 2023-10-30 21:54:33,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:33,612 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 21:54:33,614 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 21:54:33,614 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1912): 80663ddf3580f76f31d5f9b2bc6708de/family1 is initiating minor compaction (all files) 2023-10-30 21:54:33,614 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 80663ddf3580f76f31d5f9b2bc6708de/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:33,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:33,614 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2a9f439b2a411a96b5660362ec67e3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/19f452f4aa8a4a31834a50704a72339b, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/0537c43ece66432ab104e840ac7f1b2e_SeqId_46_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp, totalSize=390.1 K 2023-10-30 21:54:33,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:33,614 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=80663ddf3580f76f31d5f9b2bc6708de, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:33,614 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting af2a9f439b2a411a96b5660362ec67e3, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822322 2023-10-30 21:54:33,615 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702873614"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702873614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702873614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702873614"}]},"ts":"1698702873614"} 2023-10-30 21:54:33,615 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 19f452f4aa8a4a31834a50704a72339b, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222322 2023-10-30 21:54:33,615 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 0537c43ece66432ab104e840ac7f1b2e_SeqId_46_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878822322 2023-10-30 21:54:33,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-10-30 21:54:33,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 80663ddf3580f76f31d5f9b2bc6708de, server=jenkins-hbase4.apache.org,44371,1698702798019 in 181 msec 2023-10-30 21:54:33,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-30 21:54:33,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, REOPEN/MOVE in 617 msec 2023-10-30 21:54:33,622 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-10-30 21:54:33,622 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 621 msec 2023-10-30 21:54:33,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0380 sec 2023-10-30 21:54:33,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-10-30 21:54:33,626 INFO [Listener at localhost/36139] compactions.TestMobCompactor(278): alter status finished 2023-10-30 21:54:33,627 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:33,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 21:54:33,630 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 21:54:33,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:33,631 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703473631 2023-10-30 21:54:33,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:54:33,632 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 80663ddf3580f76f31d5f9b2bc6708de#family1#compaction#62 average throughput is 20.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:54:33,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-30 21:54:33,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:33,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x0a02dda8 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:54:33,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bc6ab08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:54:33,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:33,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:33,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:33,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:33,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:34,072 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283f37b1ee722a43659776473e5627ef70 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283f37b1ee722a43659776473e5627ef70 2023-10-30 21:54:34,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:34,086 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:54:34,087 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:54:34,094 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:54:34,096 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:54:34,106 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/474c36fcf609477c95923df53041b12a first=Optional[r05] last=Optional[r8] 2023-10-30 21:54:34,106 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=50 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/474c36fcf609477c95923df53041b12a}] 2023-10-30 21:54:34,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/474c36fcf609477c95923df53041b12a for inclusion in 80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:34,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-30 21:54:34,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:34,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:34,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/474c36fcf609477c95923df53041b12a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__h8k8cvv9bjnls20mg1q3ik92sa46ad6s8f9nbkukv6dcurrg7ak7pabm9m99425i/family1/474c36fcf609477c95923df53041b12a 2023-10-30 21:54:34,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__h8k8cvv9bjnls20mg1q3ik92sa46ad6s8f9nbkukv6dcurrg7ak7pabm9m99425i/family1/474c36fcf609477c95923df53041b12a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2c72b246e44d6cb723b9a3e0a6a31b_SeqId_52_ 2023-10-30 21:54:34,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__h8k8cvv9bjnls20mg1q3ik92sa46ad6s8f9nbkukv6dcurrg7ak7pabm9m99425i/family1/474c36fcf609477c95923df53041b12a into 80663ddf3580f76f31d5f9b2bc6708de/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2c72b246e44d6cb723b9a3e0a6a31b_SeqId_52_ - updating store file list. 2023-10-30 21:54:34,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2c72b246e44d6cb723b9a3e0a6a31b_SeqId_52_ into 80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:34,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__h8k8cvv9bjnls20mg1q3ik92sa46ad6s8f9nbkukv6dcurrg7ak7pabm9m99425i/family1/474c36fcf609477c95923df53041b12a into 80663ddf3580f76f31d5f9b2bc6708de/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2c72b246e44d6cb723b9a3e0a6a31b_SeqId_52_) 2023-10-30 21:54:34,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__h8k8cvv9bjnls20mg1q3ik92sa46ad6s8f9nbkukv6dcurrg7ak7pabm9m99425i/family1/474c36fcf609477c95923df53041b12a 2023-10-30 21:54:34,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:34,126 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:34,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112068e91ccfe693419e96697e10901d15eb to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112068e91ccfe693419e96697e10901d15eb 2023-10-30 21:54:34,128 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287993ce088ea245cc8a63f76d5878bbf3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287993ce088ea245cc8a63f76d5878bbf3 2023-10-30 21:54:34,128 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-10-30 21:54:34,128 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 21:54:34,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:34,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:34,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:34,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:34,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:34,130 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 21:54:34,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 502 msec 2023-10-30 21:54:34,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 21:54:34,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:34,595 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-30 21:54:34,596 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-30 21:54:34,596 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-30 21:54:34,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-30 21:54:34,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, REOPEN/MOVE}] 2023-10-30 21:54:34,602 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, REOPEN/MOVE 2023-10-30 21:54:34,602 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=80663ddf3580f76f31d5f9b2bc6708de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:34,602 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702874602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702874602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702874602"}]},"ts":"1698702874602"} 2023-10-30 21:54:34,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 80663ddf3580f76f31d5f9b2bc6708de, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:34,755 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:34,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:34,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80663ddf3580f76f31d5f9b2bc6708de, disabling compactions & flushes 2023-10-30 21:54:34,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:34,857 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/.tmp/family1/dbd541ba942a43cf8180d0060a08697a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/dbd541ba942a43cf8180d0060a08697a 2023-10-30 21:54:34,862 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-30 21:54:34,862 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 80663ddf3580f76f31d5f9b2bc6708de/family1 of 80663ddf3580f76f31d5f9b2bc6708de into dbd541ba942a43cf8180d0060a08697a(size=193.0 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:54:34,862 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:34,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:34,862 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de., storeName=80663ddf3580f76f31d5f9b2bc6708de/family1, priority=13, startTime=1698702873611; duration=1sec 2023-10-30 21:54:34,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:34,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. after waiting 0 ms 2023-10-30 21:54:34,862 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:34,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:34,865 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2a9f439b2a411a96b5660362ec67e3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/19f452f4aa8a4a31834a50704a72339b, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/0537c43ece66432ab104e840ac7f1b2e_SeqId_46_] to archive 2023-10-30 21:54:34,866 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:34,868 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2a9f439b2a411a96b5660362ec67e3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2a9f439b2a411a96b5660362ec67e3 2023-10-30 21:54:34,869 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/19f452f4aa8a4a31834a50704a72339b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/19f452f4aa8a4a31834a50704a72339b 2023-10-30 21:54:34,871 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/0537c43ece66432ab104e840ac7f1b2e_SeqId_46_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/0537c43ece66432ab104e840ac7f1b2e_SeqId_46_ 2023-10-30 21:54:34,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-10-30 21:54:34,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:34,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:34,877 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 80663ddf3580f76f31d5f9b2bc6708de to self. 2023-10-30 21:54:34,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:34,879 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=80663ddf3580f76f31d5f9b2bc6708de, regionState=CLOSED 2023-10-30 21:54:34,879 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702874879"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702874879"}]},"ts":"1698702874879"} 2023-10-30 21:54:34,882 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-30 21:54:34,882 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 80663ddf3580f76f31d5f9b2bc6708de, server=jenkins-hbase4.apache.org,44371,1698702798019 in 277 msec 2023-10-30 21:54:34,882 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=true 2023-10-30 21:54:35,033 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=80663ddf3580f76f31d5f9b2bc6708de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:35,033 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702875033"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702875033"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702875033"}]},"ts":"1698702875033"} 2023-10-30 21:54:35,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 80663ddf3580f76f31d5f9b2bc6708de, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:35,186 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:35,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:35,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80663ddf3580f76f31d5f9b2bc6708de, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:54:35,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:35,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:35,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:35,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:35,190 INFO [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:35,191 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:35,191 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1 2023-10-30 21:54:35,192 INFO [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80663ddf3580f76f31d5f9b2bc6708de columnFamilyName family1 2023-10-30 21:54:35,197 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/af2c72b246e44d6cb723b9a3e0a6a31b_SeqId_52_ 2023-10-30 21:54:35,199 DEBUG [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/family1/dbd541ba942a43cf8180d0060a08697a 2023-10-30 21:54:35,200 INFO [StoreOpener-80663ddf3580f76f31d5f9b2bc6708de-1] regionserver.HStore(310): Store=80663ddf3580f76f31d5f9b2bc6708de/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:35,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:35,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:35,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:54:35,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80663ddf3580f76f31d5f9b2bc6708de; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58884401, jitterRate=-0.12255404889583588}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:54:35,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:54:35,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de., pid=53, masterSystemTime=1698702875186 2023-10-30 21:54:35,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:35,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:54:35,207 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=80663ddf3580f76f31d5f9b2bc6708de, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:35,207 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698702875207"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702875207"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702875207"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702875207"}]},"ts":"1698702875207"} 2023-10-30 21:54:35,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-30 21:54:35,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 80663ddf3580f76f31d5f9b2bc6708de, server=jenkins-hbase4.apache.org,44371,1698702798019 in 174 msec 2023-10-30 21:54:35,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-10-30 21:54:35,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=80663ddf3580f76f31d5f9b2bc6708de, REOPEN/MOVE in 608 msec 2023-10-30 21:54:35,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-10-30 21:54:35,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 613 msec 2023-10-30 21:54:35,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0270 sec 2023-10-30 21:54:35,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-10-30 21:54:35,215 INFO [Listener at localhost/36139] compactions.TestMobCompactor(278): alter status finished 2023-10-30 21:54:35,216 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-30 21:54:35,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 21:54:35,218 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 21:54:35,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:35,218 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703475218 2023-10-30 21:54:35,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:54:35,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-30 21:54:35,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:35,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x636396e8 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:54:35,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dc3ef67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:54:35,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:35,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:35,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:35,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:35,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:35,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:35,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:35,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-30 21:54:35,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-30 21:54:35,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:35,226 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-30 21:54:35,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-10-30 21:54:35,280 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=253 (was 249) - Thread LEAK? -, OpenFileDescriptor=625 (was 611) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=142 (was 183), ProcessCount=169 (was 169), AvailableMemoryMB=14961 (was 14972) 2023-10-30 21:54:35,291 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=253, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=142, ProcessCount=169, AvailableMemoryMB=14961 2023-10-30 21:54:35,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-30 21:54:35,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:35,294 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:54:35,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-10-30 21:54:35,295 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:54:35,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 21:54:35,296 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:35,296 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf empty. 2023-10-30 21:54:35,297 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:35,297 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-10-30 21:54:35,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 21:54:35,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 21:54:35,704 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-30 21:54:35,706 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 566e29064d55be1b9902bdf189115faf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:54:35,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 21:54:36,111 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:36,112 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 566e29064d55be1b9902bdf189115faf, disabling compactions & flushes 2023-10-30 21:54:36,112 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:36,112 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:36,112 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. after waiting 0 ms 2023-10-30 21:54:36,112 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:36,112 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:36,112 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:36,114 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:54:36,115 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702876114"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702876114"}]},"ts":"1698702876114"} 2023-10-30 21:54:36,116 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 21:54:36,116 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:54:36,116 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702876116"}]},"ts":"1698702876116"} 2023-10-30 21:54:36,117 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-10-30 21:54:36,122 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, ASSIGN}] 2023-10-30 21:54:36,123 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, ASSIGN 2023-10-30 21:54:36,124 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:54:36,275 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=566e29064d55be1b9902bdf189115faf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:36,275 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702876275"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702876275"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702876275"}]},"ts":"1698702876275"} 2023-10-30 21:54:36,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 566e29064d55be1b9902bdf189115faf, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:36,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 21:54:36,427 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:36,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:36,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 566e29064d55be1b9902bdf189115faf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:54:36,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:36,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:36,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:36,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:36,431 INFO [StoreOpener-566e29064d55be1b9902bdf189115faf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:36,432 DEBUG [StoreOpener-566e29064d55be1b9902bdf189115faf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:36,432 DEBUG [StoreOpener-566e29064d55be1b9902bdf189115faf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:36,433 INFO [StoreOpener-566e29064d55be1b9902bdf189115faf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 566e29064d55be1b9902bdf189115faf columnFamilyName family1 2023-10-30 21:54:36,434 INFO [StoreOpener-566e29064d55be1b9902bdf189115faf-1] regionserver.HStore(310): Store=566e29064d55be1b9902bdf189115faf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:36,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:36,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:36,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:36,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:54:36,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 566e29064d55be1b9902bdf189115faf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72218958, jitterRate=0.07614633440971375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:54:36,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:36,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf., pid=57, masterSystemTime=1698702876427 2023-10-30 21:54:36,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:36,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:36,442 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=566e29064d55be1b9902bdf189115faf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:36,443 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702876442"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702876442"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702876442"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702876442"}]},"ts":"1698702876442"} 2023-10-30 21:54:36,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-10-30 21:54:36,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 566e29064d55be1b9902bdf189115faf, server=jenkins-hbase4.apache.org,44371,1698702798019 in 168 msec 2023-10-30 21:54:36,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-10-30 21:54:36,447 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, ASSIGN in 323 msec 2023-10-30 21:54:36,447 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:54:36,447 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702876447"}]},"ts":"1698702876447"} 2023-10-30 21:54:36,448 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-10-30 21:54:36,451 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:54:36,452 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1590 sec 2023-10-30 21:54:37,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-30 21:54:37,400 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-10-30 21:54:37,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:37,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:37,436 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:37,436 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:37,436 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 21:54:37,436 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 21:54:37,437 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:37,437 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:37,438 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:37,438 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:37,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:37,439 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:37,439 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:37,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:37,440 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:37,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:37,440 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 21:54:37,440 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:37,440 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 21:54:37,440 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:37,440 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:37,440 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:37,440 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. started... 2023-10-30 21:54:37,441 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 566e29064d55be1b9902bdf189115faf 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 21:54:37,861 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113094a2ff573ed1433f903ebc9fc0c60cfe to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113094a2ff573ed1433f903ebc9fc0c60cfe 2023-10-30 21:54:38,264 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/f69e99e530d445fd8c336543e7646d85 2023-10-30 21:54:38,270 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/f69e99e530d445fd8c336543e7646d85 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f69e99e530d445fd8c336543e7646d85 2023-10-30 21:54:38,275 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f69e99e530d445fd8c336543e7646d85, entries=1000, sequenceid=5, filesize=190.5 K 2023-10-30 21:54:38,275 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 566e29064d55be1b9902bdf189115faf in 834ms, sequenceid=5, compaction requested=false 2023-10-30 21:54:38,275 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:38,276 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:38,276 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:38,276 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:38,276 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:38,276 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,276 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 21:54:38,276 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 21:54:38,278 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,278 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:38,278 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,278 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:38,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:38,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:38,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 21:54:38,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37109715[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:38,280 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 21:54:38,280 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,282 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,282 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 21:54:38,282 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 21:54:38,282 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:38,282 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,282 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:38,283 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 21:54:38,283 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,283 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:38,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:38,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:38,283 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 21:54:38,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:38,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:38,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:38,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:38,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 21:54:38,286 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 21:54:38,286 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:38,286 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:38,286 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,286 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:38,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:38,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:38,288 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:38,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,289 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:38,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,295 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:38,295 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:38,295 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:38,295 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,295 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:38,295 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:38,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:38,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:38,295 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,296 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,296 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,296 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:38,296 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:38,296 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:38,396 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:38,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:38,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:38,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:38,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,402 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:38,402 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:38,402 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 21:54:38,402 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 21:54:38,402 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,402 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,403 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:38,403 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:38,404 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:38,404 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,404 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,405 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 21:54:38,405 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:38,405 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 21:54:38,405 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:38,405 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 21:54:38,405 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:38,405 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:38,405 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:38,405 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. started... 2023-10-30 21:54:38,405 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 566e29064d55be1b9902bdf189115faf 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 21:54:38,811 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:54:38,823 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287c7ebe56126b4814b68d74ae363003da to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511287c7ebe56126b4814b68d74ae363003da 2023-10-30 21:54:39,229 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/36a990511e7e4f7fbd9da254ccc33475 2023-10-30 21:54:39,234 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/36a990511e7e4f7fbd9da254ccc33475 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/36a990511e7e4f7fbd9da254ccc33475 2023-10-30 21:54:39,238 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/36a990511e7e4f7fbd9da254ccc33475, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 21:54:39,239 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 566e29064d55be1b9902bdf189115faf in 834ms, sequenceid=9, compaction requested=false 2023-10-30 21:54:39,239 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:39,239 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:39,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:39,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:39,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 21:54:39,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 21:54:39,241 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,241 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:39,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:39,241 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,241 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:39,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:39,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:39,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:39,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 21:54:39,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31bbcd16[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:39,243 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 21:54:39,243 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,244 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,244 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 21:54:39,244 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 21:54:39,244 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,244 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:39,244 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:39,246 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 21:54:39,246 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:39,246 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,246 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 21:54:39,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:39,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:39,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:39,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:39,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:39,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:39,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 21:54:39,248 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 21:54:39,248 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:39,248 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:39,248 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,249 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:39,250 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,250 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,250 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:39,250 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,252 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,254 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,254 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:39,254 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,254 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:39,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:39,254 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:39,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:39,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:39,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:39,254 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,254 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,254 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,254 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,254 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:39,255 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:39,255 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:39,355 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:39,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:39,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:39,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:39,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,361 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:39,361 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:39,361 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 21:54:39,361 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 21:54:39,362 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,362 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,363 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:39,363 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:39,363 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:39,363 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,364 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,364 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 21:54:39,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:39,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 21:54:39,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:39,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 21:54:39,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:39,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:39,364 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:39,364 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. started... 2023-10-30 21:54:39,365 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 566e29064d55be1b9902bdf189115faf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:39,777 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010f5101ca72f6471d9ddd39623ec18422 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512010f5101ca72f6471d9ddd39623ec18422 2023-10-30 21:54:40,182 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/d6997cfdfb2f4be4931137669c8f9a20 2023-10-30 21:54:40,187 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/d6997cfdfb2f4be4931137669c8f9a20 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/d6997cfdfb2f4be4931137669c8f9a20 2023-10-30 21:54:40,190 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/d6997cfdfb2f4be4931137669c8f9a20, entries=1, sequenceid=13, filesize=5.0 K 2023-10-30 21:54:40,191 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 566e29064d55be1b9902bdf189115faf in 826ms, sequenceid=13, compaction requested=true 2023-10-30 21:54:40,191 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:40,191 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:40,191 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:40,191 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:40,191 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,191 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 21:54:40,192 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 21:54:40,194 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,194 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:40,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:40,195 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,195 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:40,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:40,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:40,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:40,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 21:54:40,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@259d3b34[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:40,196 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 21:54:40,196 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,198 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,198 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 21:54:40,198 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,198 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:40,198 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 21:54:40,198 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:40,199 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 21:54:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:40,199 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 21:54:40,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:40,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:40,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:40,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:40,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 21:54:40,202 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 21:54:40,202 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:40,202 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:40,202 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,202 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:40,203 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,203 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:40,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,204 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:40,204 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:40,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,205 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:40,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:40,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:40,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:40,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:40,208 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:40,208 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,309 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:40,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:40,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:40,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:40,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,315 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:40,315 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:40,315 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 21:54:40,315 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 21:54:40,315 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,315 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,316 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:40,316 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:40,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:40,317 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:40,317 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:40,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:40,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,317 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 21:54:40,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:40,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 21:54:40,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:40,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 21:54:40,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:40,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:40,318 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:40,318 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. started... 2023-10-30 21:54:40,318 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 566e29064d55be1b9902bdf189115faf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:40,730 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120562e19e5251c14d499f7edb0cdcb7d7e1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120562e19e5251c14d499f7edb0cdcb7d7e1 2023-10-30 21:54:41,135 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/26b5730cad5b43af9042666512692abf 2023-10-30 21:54:41,139 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/26b5730cad5b43af9042666512692abf as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/26b5730cad5b43af9042666512692abf 2023-10-30 21:54:41,144 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/26b5730cad5b43af9042666512692abf, entries=1, sequenceid=17, filesize=5.0 K 2023-10-30 21:54:41,145 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 566e29064d55be1b9902bdf189115faf in 827ms, sequenceid=17, compaction requested=true 2023-10-30 21:54:41,145 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:41,145 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:41,145 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:41,145 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:41,146 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,146 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 21:54:41,146 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 21:54:41,147 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,147 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:41,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 21:54:41,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ec089e2[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:41,149 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 21:54:41,149 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,150 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,150 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 21:54:41,150 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 21:54:41,150 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:41,150 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,150 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:41,155 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 21:54:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:41,155 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 21:54:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:41,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:41,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 21:54:41,157 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 21:54:41,157 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:41,157 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:41,157 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,157 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:41,159 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,159 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:41,159 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:41,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:41,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:41,160 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,161 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,163 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,163 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,163 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,163 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:41,163 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:41,163 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 21:54:41,163 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:41,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:41,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:41,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:41,163 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:41,164 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,164 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,164 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:41,164 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:41,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:41,264 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:41,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:41,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:41,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:41,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,270 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:41,270 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:41,270 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 21:54:41,270 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 21:54:41,271 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,271 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,272 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:41,272 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:41,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:41,273 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,273 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:41,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,273 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,274 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 21:54:41,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:41,274 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 21:54:41,274 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:41,274 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 21:54:41,274 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:41,274 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:41,274 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:41,274 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. started... 2023-10-30 21:54:41,274 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 566e29064d55be1b9902bdf189115faf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:41,703 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:54:41,703 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aca4a1f to 127.0.0.1:56981 2023-10-30 21:54:41,703 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:54:41,703 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:54:41,703 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ab4c46d to 127.0.0.1:56981 2023-10-30 21:54:41,703 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:54:41,704 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x636396e8 to 127.0.0.1:56981 2023-10-30 21:54:41,704 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:54:41,704 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:54:41,704 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f891870 to 127.0.0.1:56981 2023-10-30 21:54:41,704 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:54:41,705 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286bfeb7991dbb46ab8b61fb2900e33670 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286bfeb7991dbb46ab8b61fb2900e33670 2023-10-30 21:54:41,705 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:54:41,705 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a02dda8 to 127.0.0.1:56981 2023-10-30 21:54:41,705 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:54:42,111 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/21c10fd8f9a148d29740ffb7daeeebdb 2023-10-30 21:54:42,115 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/21c10fd8f9a148d29740ffb7daeeebdb as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/21c10fd8f9a148d29740ffb7daeeebdb 2023-10-30 21:54:42,119 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/21c10fd8f9a148d29740ffb7daeeebdb, entries=1, sequenceid=21, filesize=5.0 K 2023-10-30 21:54:42,120 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 566e29064d55be1b9902bdf189115faf in 846ms, sequenceid=21, compaction requested=true 2023-10-30 21:54:42,120 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:42,120 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 21:54:42,120 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 21:54:42,122 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,122 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:42,122 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,122 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:42,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 21:54:42,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d5b0f10[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:42,124 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 21:54:42,124 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,126 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,127 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 21:54:42,127 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 21:54:42,127 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:42,127 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,127 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:42,128 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 21:54:42,128 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:42,128 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,128 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 21:54:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:42,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 21:54:42,130 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 21:54:42,130 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:42,130 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:42,130 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,130 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:42,132 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,132 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:42,132 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:42,132 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,133 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,135 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,135 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:42,135 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,135 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:42,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:42,135 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:42,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 21:54:42,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:42,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:42,135 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,136 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:42,136 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:42,136 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,136 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,136 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:42,136 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:42,236 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:42,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:42,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:42,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:42,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,242 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:42,243 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:42,243 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 21:54:42,243 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 21:54:42,243 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,243 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,245 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:42,245 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:42,246 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:42,246 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,246 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,247 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 21:54:42,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:42,247 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 21:54:42,247 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:42,247 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 21:54:42,247 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:42,247 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:42,247 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:42,247 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. started... 2023-10-30 21:54:42,247 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 566e29064d55be1b9902bdf189115faf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:42,659 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310f648c93617b4d4c94144d5c27836725 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512310f648c93617b4d4c94144d5c27836725 2023-10-30 21:54:43,064 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/9e90a4eea46c49268aca8ca1dc430711 2023-10-30 21:54:43,068 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/9e90a4eea46c49268aca8ca1dc430711 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/9e90a4eea46c49268aca8ca1dc430711 2023-10-30 21:54:43,072 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/9e90a4eea46c49268aca8ca1dc430711, entries=1, sequenceid=25, filesize=5.0 K 2023-10-30 21:54:43,073 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 566e29064d55be1b9902bdf189115faf in 826ms, sequenceid=25, compaction requested=true 2023-10-30 21:54:43,073 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:43,073 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:43,073 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:43,074 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:43,074 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,074 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 21:54:43,074 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 21:54:43,075 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,075 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:43,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:43,076 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,076 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:43,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:43,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:43,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:43,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 21:54:43,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52e7b6d0[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:43,077 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 21:54:43,078 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,079 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,079 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 21:54:43,079 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,079 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:43,079 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 21:54:43,079 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:43,081 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,081 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 21:54:43,081 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:43,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:43,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:43,081 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 21:54:43,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:43,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:43,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:43,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:43,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 21:54:43,083 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 21:54:43,083 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:43,083 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:43,083 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,083 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:43,085 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,085 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:43,085 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:43,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:43,086 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:43,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,087 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:43,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,091 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,091 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,091 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:43,091 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:43,092 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:43,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:43,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:43,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:43,092 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 21:54:43,092 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:43,092 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,092 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,092 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,092 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:43,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:43,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:43,092 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:43,192 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:43,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:43,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:43,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:43,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,199 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:43,199 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:43,199 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 21:54:43,199 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 21:54:43,199 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,199 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,203 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,203 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:43,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:43,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:43,203 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:43,203 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:43,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:43,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,204 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,204 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 21:54:43,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:43,204 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 21:54:43,204 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:43,204 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 21:54:43,204 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:43,204 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:43,204 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:43,205 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. started... 2023-10-30 21:54:43,205 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 566e29064d55be1b9902bdf189115faf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:43,616 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d52b2cb39b9a45fc9385905df12a567f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d52b2cb39b9a45fc9385905df12a567f 2023-10-30 21:54:44,022 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/ff5a3e9c1d954661a1eba75aee8eb3d4 2023-10-30 21:54:44,026 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/ff5a3e9c1d954661a1eba75aee8eb3d4 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/ff5a3e9c1d954661a1eba75aee8eb3d4 2023-10-30 21:54:44,031 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/ff5a3e9c1d954661a1eba75aee8eb3d4, entries=1, sequenceid=29, filesize=5.0 K 2023-10-30 21:54:44,031 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 566e29064d55be1b9902bdf189115faf in 826ms, sequenceid=29, compaction requested=true 2023-10-30 21:54:44,032 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:44,032 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 21:54:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 21:54:44,035 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,035 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:44,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:44,035 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,035 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:44,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:44,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:44,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:44,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 21:54:44,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1eef7323[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:44,036 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 21:54:44,036 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,038 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 21:54:44,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 21:54:44,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:44,038 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,038 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:44,039 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 21:54:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:44,039 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 21:54:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:44,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 21:54:44,041 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 21:54:44,042 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:44,042 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:44,042 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,042 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:44,043 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,043 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:44,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:44,043 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:44,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:44,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:44,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:44,044 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:44,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,045 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:44,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,048 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,049 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,049 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,049 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:44,049 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:44,049 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:44,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:44,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:44,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:44,049 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,049 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:44,049 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,049 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:44,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:44,049 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:44,049 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:44,150 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:44,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:44,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:44,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:44,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,156 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:44,156 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:44,156 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 21:54:44,156 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 21:54:44,156 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,156 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,158 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:44,158 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:44,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:44,158 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,158 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:44,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:44,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,159 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,159 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 21:54:44,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 21:54:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 21:54:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:44,159 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:44,159 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:44,159 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. started... 2023-10-30 21:54:44,160 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 566e29064d55be1b9902bdf189115faf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:44,572 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103947becd6f0174f2aa94649a9ac5f6ac8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103947becd6f0174f2aa94649a9ac5f6ac8 2023-10-30 21:54:44,979 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/799855cf47544caab4b28503c3a11eed 2023-10-30 21:54:44,983 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/799855cf47544caab4b28503c3a11eed as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/799855cf47544caab4b28503c3a11eed 2023-10-30 21:54:44,987 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/799855cf47544caab4b28503c3a11eed, entries=1, sequenceid=33, filesize=5.0 K 2023-10-30 21:54:44,988 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 566e29064d55be1b9902bdf189115faf in 828ms, sequenceid=33, compaction requested=true 2023-10-30 21:54:44,988 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:44,988 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:44,988 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:44,988 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:44,988 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,988 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 21:54:44,988 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 21:54:44,990 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,990 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:44,990 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,990 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:44,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:44,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:44,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 21:54:44,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14ea7685[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:44,991 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 21:54:44,991 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,993 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,993 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 21:54:44,993 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 21:54:44,993 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:44,993 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,993 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:44,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 21:54:44,996 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:44,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:44,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 21:54:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:44,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:44,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 21:54:44,998 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 21:54:44,998 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:44,998 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:44,998 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:44,998 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:45,000 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,000 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:45,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:45,000 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:45,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:45,000 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:45,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,001 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:45,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,003 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:45,004 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:45,004 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:45,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:45,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:45,004 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:45,004 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-30 21:54:45,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:45,004 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,004 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:45,004 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:45,004 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,004 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,004 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,004 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,104 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:45,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:45,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:45,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:45,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,112 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:45,112 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:45,112 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 21:54:45,112 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 21:54:45,112 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,112 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,115 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:45,115 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:45,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:45,115 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,115 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:45,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:45,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,116 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,117 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 21:54:45,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,117 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 21:54:45,117 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:45,117 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 21:54:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:45,118 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:45,118 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. started... 2023-10-30 21:54:45,118 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 566e29064d55be1b9902bdf189115faf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:45,534 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c1f695619b954a77821cc933973eb650 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907c1f695619b954a77821cc933973eb650 2023-10-30 21:54:45,939 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/b4df63f547444524a25e4f7d56dabe71 2023-10-30 21:54:45,944 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/b4df63f547444524a25e4f7d56dabe71 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/b4df63f547444524a25e4f7d56dabe71 2023-10-30 21:54:45,947 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/b4df63f547444524a25e4f7d56dabe71, entries=1, sequenceid=37, filesize=5.0 K 2023-10-30 21:54:45,948 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 566e29064d55be1b9902bdf189115faf in 830ms, sequenceid=37, compaction requested=true 2023-10-30 21:54:45,948 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:45,948 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:45,948 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:45,948 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:45,948 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,948 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 21:54:45,948 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 21:54:45,950 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,950 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:45,950 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,950 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:45,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:45,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 21:54:45,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71acd887[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:45,951 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 21:54:45,951 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,952 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,952 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 21:54:45,952 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 21:54:45,952 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:45,952 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,952 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:45,954 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 21:54:45,954 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:45,954 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,954 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 21:54:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:45,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:45,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 21:54:45,956 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 21:54:45,956 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:45,956 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:45,956 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,956 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:45,958 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,958 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:45,958 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:45,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:45,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:45,959 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,960 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:45,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,962 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,962 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:45,962 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,962 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:45,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:45,962 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:45,962 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:45,962 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:45,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:45,962 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,962 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:45,962 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:45,962 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:45,963 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:46,063 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:46,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:46,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:54:46,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-30 21:54:46,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,068 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:46,068 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:46,068 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-30 21:54:46,068 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-30 21:54:46,069 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,069 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,070 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:46,070 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:46,070 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,070 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:54:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:54:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,071 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,071 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-30 21:54:46,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,071 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-30 21:54:46,071 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:54:46,072 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-30 21:54:46,072 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:54:46,072 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:54:46,072 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:46,072 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. started... 2023-10-30 21:54:46,072 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 566e29064d55be1b9902bdf189115faf 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:54:46,484 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a14a2741aff64e74ab51a751add6f4c1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120a14a2741aff64e74ab51a751add6f4c1 2023-10-30 21:54:46,889 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/f333b3d5387147f2b6ae72b746e5cf88 2023-10-30 21:54:46,893 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/f333b3d5387147f2b6ae72b746e5cf88 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f333b3d5387147f2b6ae72b746e5cf88 2023-10-30 21:54:46,897 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f333b3d5387147f2b6ae72b746e5cf88, entries=1, sequenceid=41, filesize=5.0 K 2023-10-30 21:54:46,897 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 566e29064d55be1b9902bdf189115faf in 825ms, sequenceid=41, compaction requested=true 2023-10-30 21:54:46,898 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:46,898 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:46,898 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:54:46,898 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:54:46,898 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,898 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-30 21:54:46,898 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-30 21:54:46,899 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,899 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:46,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:46,900 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,900 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:54:46,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:46,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:46,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:46,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-30 21:54:46,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e12b154[Count = 0] remaining members to acquire global barrier 2023-10-30 21:54:46,901 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-30 21:54:46,901 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,903 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,903 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-30 21:54:46,903 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-30 21:54:46,903 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:54:46,903 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,903 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:54:46,904 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,904 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-30 21:54:46,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:46,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:46,904 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:46,904 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-30 21:54:46,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:46,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:46,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:46,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:54:46,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-30 21:54:46,906 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-30 21:54:46,906 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:54:46,906 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:54:46,906 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,906 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:54:46,908 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,908 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:54:46,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:54:46,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,908 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:46,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:54:46,908 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:46,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:46,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:54:46,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,909 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:54:46,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,911 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,911 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,911 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:54:46,911 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:54:46,911 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:54:46,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:54:46,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:54:46,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-30 21:54:46,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:54:46,911 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,912 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:46,912 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,912 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,912 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:46,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:54:46,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:54:46,912 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-30 21:54:46,912 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:54:47,012 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:54:47,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:54:47,014 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:47,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 21:54:47,016 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 21:54:47,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:47,017 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703487017 2023-10-30 21:54:47,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:54:47,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-30 21:54:47,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:47,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x6abeeaf6 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:54:47,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@330710ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:54:47,025 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:47,859 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036eb4d14d4c4f44f4a9d72755fa940f50 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601036eb4d14d4c4f44f4a9d72755fa940f50 2023-10-30 21:54:47,860 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:47,874 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:54:47,875 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:54:47,883 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:54:47,884 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:54:47,891 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/99a2932a8b934a9ab73f2d5e2c3a33fd first=Optional[r3] last=Optional[r6] 2023-10-30 21:54:47,892 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/99a2932a8b934a9ab73f2d5e2c3a33fd}] 2023-10-30 21:54:47,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/99a2932a8b934a9ab73f2d5e2c3a33fd for inclusion in 566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:47,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-30 21:54:47,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:47,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:47,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/99a2932a8b934a9ab73f2d5e2c3a33fd to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__95rd3u79l52ftk47g32sb5ctfe53jn4otnipdip16sehth26i5qc8oo0pcp9bj48/family1/99a2932a8b934a9ab73f2d5e2c3a33fd 2023-10-30 21:54:47,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__95rd3u79l52ftk47g32sb5ctfe53jn4otnipdip16sehth26i5qc8oo0pcp9bj48/family1/99a2932a8b934a9ab73f2d5e2c3a33fd as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/72ecbcb12e974d09b7fc05fb8b437aea_SeqId_44_ 2023-10-30 21:54:47,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__95rd3u79l52ftk47g32sb5ctfe53jn4otnipdip16sehth26i5qc8oo0pcp9bj48/family1/99a2932a8b934a9ab73f2d5e2c3a33fd into 566e29064d55be1b9902bdf189115faf/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/72ecbcb12e974d09b7fc05fb8b437aea_SeqId_44_ - updating store file list. 2023-10-30 21:54:47,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/72ecbcb12e974d09b7fc05fb8b437aea_SeqId_44_ into 566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:47,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__95rd3u79l52ftk47g32sb5ctfe53jn4otnipdip16sehth26i5qc8oo0pcp9bj48/family1/99a2932a8b934a9ab73f2d5e2c3a33fd into 566e29064d55be1b9902bdf189115faf/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/72ecbcb12e974d09b7fc05fb8b437aea_SeqId_44_) 2023-10-30 21:54:47,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__95rd3u79l52ftk47g32sb5ctfe53jn4otnipdip16sehth26i5qc8oo0pcp9bj48/family1/99a2932a8b934a9ab73f2d5e2c3a33fd 2023-10-30 21:54:47,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 21:54:47,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 21:54:47,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 566e29064d55be1b9902bdf189115faf/family1 is initiating minor compaction 2023-10-30 21:54:47,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5dbbbffa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:47,909 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 566e29064d55be1b9902bdf189115faf/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:47,909 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/36a990511e7e4f7fbd9da254ccc33475, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/d6997cfdfb2f4be4931137669c8f9a20, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/26b5730cad5b43af9042666512692abf, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/21c10fd8f9a148d29740ffb7daeeebdb, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/9e90a4eea46c49268aca8ca1dc430711, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/ff5a3e9c1d954661a1eba75aee8eb3d4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/799855cf47544caab4b28503c3a11eed, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/b4df63f547444524a25e4f7d56dabe71, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f333b3d5387147f2b6ae72b746e5cf88, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/72ecbcb12e974d09b7fc05fb8b437aea_SeqId_44_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp, totalSize=50.3 K 2023-10-30 21:54:47,909 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 36a990511e7e4f7fbd9da254ccc33475, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 21:54:47,909 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting d6997cfdfb2f4be4931137669c8f9a20, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 21:54:47,909 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 26b5730cad5b43af9042666512692abf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 21:54:47,909 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 21c10fd8f9a148d29740ffb7daeeebdb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 21:54:47,909 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 9e90a4eea46c49268aca8ca1dc430711, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 21:54:47,909 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting ff5a3e9c1d954661a1eba75aee8eb3d4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 21:54:47,909 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 799855cf47544caab4b28503c3a11eed, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 21:54:47,909 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting b4df63f547444524a25e4f7d56dabe71, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 21:54:47,909 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting f333b3d5387147f2b6ae72b746e5cf88, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 21:54:47,909 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 72ecbcb12e974d09b7fc05fb8b437aea_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 21:54:47,911 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:47,911 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:47,913 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286bfeb7991dbb46ab8b61fb2900e33670 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286bfeb7991dbb46ab8b61fb2900e33670 2023-10-30 21:54:47,914 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512310f648c93617b4d4c94144d5c27836725 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512310f648c93617b4d4c94144d5c27836725 2023-10-30 21:54:47,915 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d52b2cb39b9a45fc9385905df12a567f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101d52b2cb39b9a45fc9385905df12a567f 2023-10-30 21:54:47,916 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103947becd6f0174f2aa94649a9ac5f6ac8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103947becd6f0174f2aa94649a9ac5f6ac8 2023-10-30 21:54:47,916 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-10-30 21:54:47,916 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-30 21:54:47,917 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:47,917 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:47,917 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:47,917 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:47,917 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:47,917 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:47,917 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:47,917 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:47,943 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 566e29064d55be1b9902bdf189115faf#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:54:48,761 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/a3a7b6969288410ea014a9b90eb619e4 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/a3a7b6969288410ea014a9b90eb619e4 2023-10-30 21:54:48,765 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052d600aeb37ba469c9175cadacf387181 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052d600aeb37ba469c9175cadacf387181 2023-10-30 21:54:48,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:48,766 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 566e29064d55be1b9902bdf189115faf/family1 of 566e29064d55be1b9902bdf189115faf into a3a7b6969288410ea014a9b90eb619e4(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:54:48,766 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:48,766 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698702887908; duration=0sec 2023-10-30 21:54:48,766 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:48,788 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/006225fc416c4fa8be4b74cc628328f8 first=Optional[r00] last=Optional[r2] 2023-10-30 21:54:48,789 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/006225fc416c4fa8be4b74cc628328f8}] 2023-10-30 21:54:48,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/006225fc416c4fa8be4b74cc628328f8 for inclusion in 566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:48,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-30 21:54:48,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:48,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:48,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/006225fc416c4fa8be4b74cc628328f8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cr1tfk7p9fu700b6hocfc3v3jfvc8k8c8j6lembdsaooc3a8fq147j6r2agd777h/family1/006225fc416c4fa8be4b74cc628328f8 2023-10-30 21:54:48,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cr1tfk7p9fu700b6hocfc3v3jfvc8k8c8j6lembdsaooc3a8fq147j6r2agd777h/family1/006225fc416c4fa8be4b74cc628328f8 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/e6557d2fcf9646cabd58f324461eb38e_SeqId_47_ 2023-10-30 21:54:48,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cr1tfk7p9fu700b6hocfc3v3jfvc8k8c8j6lembdsaooc3a8fq147j6r2agd777h/family1/006225fc416c4fa8be4b74cc628328f8 into 566e29064d55be1b9902bdf189115faf/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/e6557d2fcf9646cabd58f324461eb38e_SeqId_47_ - updating store file list. 2023-10-30 21:54:48,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/e6557d2fcf9646cabd58f324461eb38e_SeqId_47_ into 566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:48,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cr1tfk7p9fu700b6hocfc3v3jfvc8k8c8j6lembdsaooc3a8fq147j6r2agd777h/family1/006225fc416c4fa8be4b74cc628328f8 into 566e29064d55be1b9902bdf189115faf/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/e6557d2fcf9646cabd58f324461eb38e_SeqId_47_) 2023-10-30 21:54:48,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cr1tfk7p9fu700b6hocfc3v3jfvc8k8c8j6lembdsaooc3a8fq147j6r2agd777h/family1/006225fc416c4fa8be4b74cc628328f8 2023-10-30 21:54:48,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-30 21:54:48,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-30 21:54:48,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 566e29064d55be1b9902bdf189115faf/family1 is initiating minor compaction (all files) 2023-10-30 21:54:48,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@83ad3e3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:48,802 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 566e29064d55be1b9902bdf189115faf/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:48,802 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f69e99e530d445fd8c336543e7646d85, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/a3a7b6969288410ea014a9b90eb619e4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/e6557d2fcf9646cabd58f324461eb38e_SeqId_47_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp, totalSize=388.1 K 2023-10-30 21:54:48,803 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting f69e99e530d445fd8c336543e7646d85, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822322 2023-10-30 21:54:48,803 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting a3a7b6969288410ea014a9b90eb619e4, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222322 2023-10-30 21:54:48,804 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting e6557d2fcf9646cabd58f324461eb38e_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878822322 2023-10-30 21:54:48,804 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:48,804 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:48,806 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113094a2ff573ed1433f903ebc9fc0c60cfe to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113094a2ff573ed1433f903ebc9fc0c60cfe 2023-10-30 21:54:48,807 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512010f5101ca72f6471d9ddd39623ec18422 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512010f5101ca72f6471d9ddd39623ec18422 2023-10-30 21:54:48,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120562e19e5251c14d499f7edb0cdcb7d7e1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120562e19e5251c14d499f7edb0cdcb7d7e1 2023-10-30 21:54:48,808 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-10-30 21:54:48,808 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-30 21:54:48,808 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:48,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:48,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:48,810 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 21:54:48,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.7960 sec 2023-10-30 21:54:48,817 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] throttle.PressureAwareThroughputController(145): 566e29064d55be1b9902bdf189115faf#family1#compaction#74 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:54:48,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 21:54:48,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:48,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/36a990511e7e4f7fbd9da254ccc33475, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/d6997cfdfb2f4be4931137669c8f9a20, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/26b5730cad5b43af9042666512692abf, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/21c10fd8f9a148d29740ffb7daeeebdb, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/9e90a4eea46c49268aca8ca1dc430711, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/ff5a3e9c1d954661a1eba75aee8eb3d4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/799855cf47544caab4b28503c3a11eed, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/b4df63f547444524a25e4f7d56dabe71, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f333b3d5387147f2b6ae72b746e5cf88, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/72ecbcb12e974d09b7fc05fb8b437aea_SeqId_44_] to archive 2023-10-30 21:54:48,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:48,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/36a990511e7e4f7fbd9da254ccc33475 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/36a990511e7e4f7fbd9da254ccc33475 2023-10-30 21:54:48,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/d6997cfdfb2f4be4931137669c8f9a20 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/d6997cfdfb2f4be4931137669c8f9a20 2023-10-30 21:54:48,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/26b5730cad5b43af9042666512692abf to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/26b5730cad5b43af9042666512692abf 2023-10-30 21:54:48,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/21c10fd8f9a148d29740ffb7daeeebdb to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/21c10fd8f9a148d29740ffb7daeeebdb 2023-10-30 21:54:48,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/9e90a4eea46c49268aca8ca1dc430711 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/9e90a4eea46c49268aca8ca1dc430711 2023-10-30 21:54:48,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/ff5a3e9c1d954661a1eba75aee8eb3d4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/ff5a3e9c1d954661a1eba75aee8eb3d4 2023-10-30 21:54:48,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/799855cf47544caab4b28503c3a11eed to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/799855cf47544caab4b28503c3a11eed 2023-10-30 21:54:48,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/b4df63f547444524a25e4f7d56dabe71 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/b4df63f547444524a25e4f7d56dabe71 2023-10-30 21:54:48,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f333b3d5387147f2b6ae72b746e5cf88 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f333b3d5387147f2b6ae72b746e5cf88 2023-10-30 21:54:48,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/72ecbcb12e974d09b7fc05fb8b437aea_SeqId_44_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/72ecbcb12e974d09b7fc05fb8b437aea_SeqId_44_ 2023-10-30 21:54:49,286 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-30 21:54:49,287 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-30 21:54:49,287 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-30 21:54:49,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-30 21:54:49,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, REOPEN/MOVE}] 2023-10-30 21:54:49,292 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, REOPEN/MOVE 2023-10-30 21:54:49,293 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=566e29064d55be1b9902bdf189115faf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:49,293 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702889293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702889293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702889293"}]},"ts":"1698702889293"} 2023-10-30 21:54:49,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 566e29064d55be1b9902bdf189115faf, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:49,446 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:49,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:49,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 566e29064d55be1b9902bdf189115faf, disabling compactions & flushes 2023-10-30 21:54:49,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:50,034 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/.tmp/family1/9483b45f078f42b09af195233ba92f32 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/9483b45f078f42b09af195233ba92f32 2023-10-30 21:54:50,039 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 566e29064d55be1b9902bdf189115faf/family1 of 566e29064d55be1b9902bdf189115faf into 9483b45f078f42b09af195233ba92f32(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:54:50,039 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:50,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:50,039 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1698702888802; duration=1sec 2023-10-30 21:54:50,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:50,039 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:50,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. after waiting 0 ms 2023-10-30 21:54:50,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:50,042 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f69e99e530d445fd8c336543e7646d85, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/a3a7b6969288410ea014a9b90eb619e4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/e6557d2fcf9646cabd58f324461eb38e_SeqId_47_] to archive 2023-10-30 21:54:50,043 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:50,044 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f69e99e530d445fd8c336543e7646d85 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/f69e99e530d445fd8c336543e7646d85 2023-10-30 21:54:50,045 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/a3a7b6969288410ea014a9b90eb619e4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/a3a7b6969288410ea014a9b90eb619e4 2023-10-30 21:54:50,046 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/e6557d2fcf9646cabd58f324461eb38e_SeqId_47_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/e6557d2fcf9646cabd58f324461eb38e_SeqId_47_ 2023-10-30 21:54:50,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 21:54:50,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:50,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:50,051 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 566e29064d55be1b9902bdf189115faf to self. 2023-10-30 21:54:50,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:50,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=566e29064d55be1b9902bdf189115faf, regionState=CLOSED 2023-10-30 21:54:50,053 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702890052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702890052"}]},"ts":"1698702890052"} 2023-10-30 21:54:50,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-10-30 21:54:50,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 566e29064d55be1b9902bdf189115faf, server=jenkins-hbase4.apache.org,44371,1698702798019 in 759 msec 2023-10-30 21:54:50,055 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=true 2023-10-30 21:54:50,205 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=566e29064d55be1b9902bdf189115faf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:50,205 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702890205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702890205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702890205"}]},"ts":"1698702890205"} 2023-10-30 21:54:50,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 566e29064d55be1b9902bdf189115faf, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:50,358 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:50,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:50,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 566e29064d55be1b9902bdf189115faf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:54:50,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:50,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:50,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:50,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:50,363 INFO [StoreOpener-566e29064d55be1b9902bdf189115faf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:50,364 DEBUG [StoreOpener-566e29064d55be1b9902bdf189115faf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:50,364 DEBUG [StoreOpener-566e29064d55be1b9902bdf189115faf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:50,365 INFO [StoreOpener-566e29064d55be1b9902bdf189115faf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 566e29064d55be1b9902bdf189115faf columnFamilyName family1 2023-10-30 21:54:50,369 DEBUG [StoreOpener-566e29064d55be1b9902bdf189115faf-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/9483b45f078f42b09af195233ba92f32 2023-10-30 21:54:50,370 INFO [StoreOpener-566e29064d55be1b9902bdf189115faf-1] regionserver.HStore(310): Store=566e29064d55be1b9902bdf189115faf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:50,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:50,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:50,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:50,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 566e29064d55be1b9902bdf189115faf; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67258149, jitterRate=0.0022245198488235474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:54:50,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:50,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf., pid=63, masterSystemTime=1698702890358 2023-10-30 21:54:50,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:50,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:50,376 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=566e29064d55be1b9902bdf189115faf, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:50,377 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702890376"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702890376"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702890376"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702890376"}]},"ts":"1698702890376"} 2023-10-30 21:54:50,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-10-30 21:54:50,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 566e29064d55be1b9902bdf189115faf, server=jenkins-hbase4.apache.org,44371,1698702798019 in 171 msec 2023-10-30 21:54:50,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-10-30 21:54:50,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, REOPEN/MOVE in 1.0880 sec 2023-10-30 21:54:50,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-30 21:54:50,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0910 sec 2023-10-30 21:54:50,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5140 sec 2023-10-30 21:54:50,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-10-30 21:54:50,385 INFO [Listener at localhost/36139] compactions.TestMobCompactor(278): alter status finished 2023-10-30 21:54:50,386 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:50,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 21:54:50,387 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 21:54:50,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:50,388 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703490388 2023-10-30 21:54:50,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:54:50,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-30 21:54:50,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:50,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x09b9d96a to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:54:50,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20789533, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:54:50,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:50,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:50,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:50,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:50,395 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:51,218 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128045bbb55e4ba4de488a8d9e75da5fd71 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128045bbb55e4ba4de488a8d9e75da5fd71 2023-10-30 21:54:51,219 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:51,231 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:54:51,232 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:54:51,237 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:54:51,239 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:54:51,247 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/79476ff1cc914536a5a200ad05db1ea7 first=Optional[r05] last=Optional[r8] 2023-10-30 21:54:51,248 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/79476ff1cc914536a5a200ad05db1ea7}] 2023-10-30 21:54:51,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/79476ff1cc914536a5a200ad05db1ea7 for inclusion in 566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:51,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-30 21:54:51,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:51,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:51,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/79476ff1cc914536a5a200ad05db1ea7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ujle96ib8e2nd84i9vrg9hghah6iosb0dfot195pblactq2oob3020ep9lafk6ds/family1/79476ff1cc914536a5a200ad05db1ea7 2023-10-30 21:54:51,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ujle96ib8e2nd84i9vrg9hghah6iosb0dfot195pblactq2oob3020ep9lafk6ds/family1/79476ff1cc914536a5a200ad05db1ea7 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/7c5bb014abc34975a770cda046e2d038_SeqId_53_ 2023-10-30 21:54:51,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ujle96ib8e2nd84i9vrg9hghah6iosb0dfot195pblactq2oob3020ep9lafk6ds/family1/79476ff1cc914536a5a200ad05db1ea7 into 566e29064d55be1b9902bdf189115faf/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/7c5bb014abc34975a770cda046e2d038_SeqId_53_ - updating store file list. 2023-10-30 21:54:51,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/7c5bb014abc34975a770cda046e2d038_SeqId_53_ into 566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:51,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ujle96ib8e2nd84i9vrg9hghah6iosb0dfot195pblactq2oob3020ep9lafk6ds/family1/79476ff1cc914536a5a200ad05db1ea7 into 566e29064d55be1b9902bdf189115faf/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/7c5bb014abc34975a770cda046e2d038_SeqId_53_) 2023-10-30 21:54:51,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ujle96ib8e2nd84i9vrg9hghah6iosb0dfot195pblactq2oob3020ep9lafk6ds/family1/79476ff1cc914536a5a200ad05db1ea7 2023-10-30 21:54:51,262 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:51,262 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:51,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120a14a2741aff64e74ab51a751add6f4c1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120a14a2741aff64e74ab51a751add6f4c1 2023-10-30 21:54:51,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511287c7ebe56126b4814b68d74ae363003da to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511287c7ebe56126b4814b68d74ae363003da 2023-10-30 21:54:51,265 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-10-30 21:54:51,265 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 21:54:51,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:51,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:51,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:51,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:51,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:51,266 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 21:54:51,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 880 msec 2023-10-30 21:54:51,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-10-30 21:54:51,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:51,727 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-30 21:54:51,727 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-30 21:54:51,728 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-30 21:54:51,729 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-30 21:54:51,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, REOPEN/MOVE}] 2023-10-30 21:54:51,733 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, REOPEN/MOVE 2023-10-30 21:54:51,733 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=566e29064d55be1b9902bdf189115faf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:51,733 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702891733"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702891733"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702891733"}]},"ts":"1698702891733"} 2023-10-30 21:54:51,735 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 566e29064d55be1b9902bdf189115faf, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:51,886 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:51,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:51,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 566e29064d55be1b9902bdf189115faf, disabling compactions & flushes 2023-10-30 21:54:51,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:51,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:51,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. after waiting 0 ms 2023-10-30 21:54:51,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:51,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-30 21:54:51,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:51,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:51,893 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 566e29064d55be1b9902bdf189115faf to self. 2023-10-30 21:54:51,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:51,895 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=566e29064d55be1b9902bdf189115faf, regionState=CLOSED 2023-10-30 21:54:51,895 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702891895"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702891895"}]},"ts":"1698702891895"} 2023-10-30 21:54:51,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-10-30 21:54:51,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 566e29064d55be1b9902bdf189115faf, server=jenkins-hbase4.apache.org,44371,1698702798019 in 161 msec 2023-10-30 21:54:51,897 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=true 2023-10-30 21:54:52,048 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=566e29064d55be1b9902bdf189115faf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:52,048 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702892048"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702892048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702892048"}]},"ts":"1698702892048"} 2023-10-30 21:54:52,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 566e29064d55be1b9902bdf189115faf, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:52,201 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:52,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:52,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 566e29064d55be1b9902bdf189115faf, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:54:52,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:52,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:52,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:52,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:52,205 INFO [StoreOpener-566e29064d55be1b9902bdf189115faf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:52,206 DEBUG [StoreOpener-566e29064d55be1b9902bdf189115faf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:52,206 DEBUG [StoreOpener-566e29064d55be1b9902bdf189115faf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1 2023-10-30 21:54:52,206 INFO [StoreOpener-566e29064d55be1b9902bdf189115faf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 566e29064d55be1b9902bdf189115faf columnFamilyName family1 2023-10-30 21:54:52,211 DEBUG [StoreOpener-566e29064d55be1b9902bdf189115faf-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/7c5bb014abc34975a770cda046e2d038_SeqId_53_ 2023-10-30 21:54:52,214 DEBUG [StoreOpener-566e29064d55be1b9902bdf189115faf-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/family1/9483b45f078f42b09af195233ba92f32 2023-10-30 21:54:52,214 INFO [StoreOpener-566e29064d55be1b9902bdf189115faf-1] regionserver.HStore(310): Store=566e29064d55be1b9902bdf189115faf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:52,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:52,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:52,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 566e29064d55be1b9902bdf189115faf 2023-10-30 21:54:52,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 566e29064d55be1b9902bdf189115faf; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72316185, jitterRate=0.07759512960910797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:54:52,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:54:52,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf., pid=69, masterSystemTime=1698702892201 2023-10-30 21:54:52,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:52,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:54:52,221 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=566e29064d55be1b9902bdf189115faf, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:52,222 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698702892221"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702892221"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702892221"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702892221"}]},"ts":"1698702892221"} 2023-10-30 21:54:52,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-30 21:54:52,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 566e29064d55be1b9902bdf189115faf, server=jenkins-hbase4.apache.org,44371,1698702798019 in 174 msec 2023-10-30 21:54:52,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-30 21:54:52,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=566e29064d55be1b9902bdf189115faf, REOPEN/MOVE in 492 msec 2023-10-30 21:54:52,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-10-30 21:54:52,227 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 497 msec 2023-10-30 21:54:52,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 911 msec 2023-10-30 21:54:52,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-10-30 21:54:52,231 INFO [Listener at localhost/36139] compactions.TestMobCompactor(278): alter status finished 2023-10-30 21:54:52,232 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-30 21:54:52,233 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 21:54:52,234 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 21:54:52,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:52,234 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703492234 2023-10-30 21:54:52,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:54:52,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-30 21:54:52,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:52,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x748f84da to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:54:52,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@732b25c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:54:52,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:52,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:52,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:52,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:52,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:52,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:52,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:52,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-30 21:54:52,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-30 21:54:52,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:52,243 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-30 21:54:52,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 11 msec 2023-10-30 21:54:52,292 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243 (was 253), OpenFileDescriptor=618 (was 625), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=117 (was 142), ProcessCount=167 (was 169), AvailableMemoryMB=14923 (was 14961) 2023-10-30 21:54:52,304 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=243, OpenFileDescriptor=618, MaxFileDescriptor=60000, SystemLoadAverage=117, ProcessCount=167, AvailableMemoryMB=14923 2023-10-30 21:54:52,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 21:54:52,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-10-30 21:54:52,308 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:54:52,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-10-30 21:54:52,309 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:54:52,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 21:54:52,310 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:52,310 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37 empty. 2023-10-30 21:54:52,311 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:52,311 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-30 21:54:52,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 21:54:52,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 21:54:52,718 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-10-30 21:54:52,719 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 83c5fe67b72c91963deb2a6f7fe9af37, NAME => 'testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:54:52,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 21:54:53,125 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:53,125 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 83c5fe67b72c91963deb2a6f7fe9af37, disabling compactions & flushes 2023-10-30 21:54:53,125 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:53,125 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:53,125 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. after waiting 0 ms 2023-10-30 21:54:53,125 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:53,125 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:53,125 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 83c5fe67b72c91963deb2a6f7fe9af37: 2023-10-30 21:54:53,127 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:54:53,128 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698702893128"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702893128"}]},"ts":"1698702893128"} 2023-10-30 21:54:53,129 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 21:54:53,129 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:54:53,130 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702893129"}]},"ts":"1698702893129"} 2023-10-30 21:54:53,130 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-10-30 21:54:53,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=83c5fe67b72c91963deb2a6f7fe9af37, ASSIGN}] 2023-10-30 21:54:53,140 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=83c5fe67b72c91963deb2a6f7fe9af37, ASSIGN 2023-10-30 21:54:53,141 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=83c5fe67b72c91963deb2a6f7fe9af37, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:54:53,292 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=83c5fe67b72c91963deb2a6f7fe9af37, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:53,292 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698702893291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702893291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702893291"}]},"ts":"1698702893291"} 2023-10-30 21:54:53,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 83c5fe67b72c91963deb2a6f7fe9af37, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:53,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 21:54:53,445 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:53,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:53,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83c5fe67b72c91963deb2a6f7fe9af37, NAME => 'testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:54:53,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-10-30 21:54:53,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-10-30 21:54:53,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:53,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:53,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:53,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:53,451 INFO [StoreOpener-83c5fe67b72c91963deb2a6f7fe9af37-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:53,452 DEBUG [StoreOpener-83c5fe67b72c91963deb2a6f7fe9af37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1 2023-10-30 21:54:53,452 DEBUG [StoreOpener-83c5fe67b72c91963deb2a6f7fe9af37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1 2023-10-30 21:54:53,453 INFO [StoreOpener-83c5fe67b72c91963deb2a6f7fe9af37-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83c5fe67b72c91963deb2a6f7fe9af37 columnFamilyName f1 2023-10-30 21:54:53,454 INFO [StoreOpener-83c5fe67b72c91963deb2a6f7fe9af37-1] regionserver.HStore(310): Store=83c5fe67b72c91963deb2a6f7fe9af37/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:53,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:53,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:53,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:53,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:54:53,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 83c5fe67b72c91963deb2a6f7fe9af37; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68472317, jitterRate=0.02031703293323517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:54:53,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 83c5fe67b72c91963deb2a6f7fe9af37: 2023-10-30 21:54:53,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37., pid=73, masterSystemTime=1698702893445 2023-10-30 21:54:53,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:53,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:53,461 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=83c5fe67b72c91963deb2a6f7fe9af37, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:53,462 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698702893461"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702893461"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702893461"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702893461"}]},"ts":"1698702893461"} 2023-10-30 21:54:53,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-10-30 21:54:53,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 83c5fe67b72c91963deb2a6f7fe9af37, server=jenkins-hbase4.apache.org,44371,1698702798019 in 170 msec 2023-10-30 21:54:53,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-30 21:54:53,465 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=83c5fe67b72c91963deb2a6f7fe9af37, ASSIGN in 325 msec 2023-10-30 21:54:53,465 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:54:53,465 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702893465"}]},"ts":"1698702893465"} 2023-10-30 21:54:53,466 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-10-30 21:54:53,468 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:54:53,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1620 sec 2023-10-30 21:54:54,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-30 21:54:54,414 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-10-30 21:54:54,414 DEBUG [Listener at localhost/36139] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-10-30 21:54:54,415 INFO [Listener at localhost/36139] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-30 21:54:54,418 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-10-30 21:54:54,419 INFO [Listener at localhost/36139] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-30 21:54:54,419 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-10-30 21:54:54,423 INFO [Listener at localhost/36139] regionserver.HRegion(2745): Flushing 83c5fe67b72c91963deb2a6f7fe9af37 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-30 21:54:54,834 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103046e50dbe5d514f4ca4ccb981c77f5570 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023103046e50dbe5d514f4ca4ccb981c77f5570 2023-10-30 21:54:55,240 INFO [Listener at localhost/36139] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/.tmp/f1/70d2207ef0314c399b96f67b8cdb15a2 2023-10-30 21:54:55,245 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/.tmp/f1/70d2207ef0314c399b96f67b8cdb15a2 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2 2023-10-30 21:54:55,249 INFO [Listener at localhost/36139] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2, entries=1, sequenceid=5, filesize=4.9 K 2023-10-30 21:54:55,250 INFO [Listener at localhost/36139] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 83c5fe67b72c91963deb2a6f7fe9af37 in 827ms, sequenceid=5, compaction requested=false 2023-10-30 21:54:55,250 DEBUG [Listener at localhost/36139] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-10-30 21:54:55,251 DEBUG [Listener at localhost/36139] regionserver.HRegion(2446): Flush status journal for 83c5fe67b72c91963deb2a6f7fe9af37: 2023-10-30 21:54:55,252 INFO [Listener at localhost/36139] regionserver.HRegion(2745): Flushing 83c5fe67b72c91963deb2a6f7fe9af37 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-30 21:54:55,587 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:54:55,663 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103025ac819ffd834929b1e327544a5f81ab to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023103025ac819ffd834929b1e327544a5f81ab 2023-10-30 21:54:56,072 INFO [Listener at localhost/36139] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/.tmp/f1/86565ee29ca243a98965a51da432ff27 2023-10-30 21:54:56,076 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/.tmp/f1/86565ee29ca243a98965a51da432ff27 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27 2023-10-30 21:54:56,080 INFO [Listener at localhost/36139] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27, entries=1, sequenceid=9, filesize=4.9 K 2023-10-30 21:54:56,081 INFO [Listener at localhost/36139] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 83c5fe67b72c91963deb2a6f7fe9af37 in 829ms, sequenceid=9, compaction requested=false 2023-10-30 21:54:56,081 DEBUG [Listener at localhost/36139] regionserver.HRegion(2446): Flush status journal for 83c5fe67b72c91963deb2a6f7fe9af37: 2023-10-30 21:54:56,082 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-10-30 21:54:56,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-30 21:54:56,084 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-30 21:54:56,084 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703496084 2023-10-30 21:54:56,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:56,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 21:54:56,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-10-30 21:54:56,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-10-30 21:54:56,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x4586f70f to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:54:56,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57340db1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:54:56,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testGetAfterCompaction' and column='f1' 2023-10-30 21:54:56,134 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,134 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,185 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,185 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,236 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,236 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,287 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,287 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,338 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,338 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,389 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,389 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,440 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,440 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,491 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,491 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,542 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,542 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,593 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,593 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,644 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,644 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,695 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,695 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,746 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,746 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,797 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,797 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,848 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,848 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,899 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,899 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,919 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030340a979e93a0443d9855cab04e706a0a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231030340a979e93a0443d9855cab04e706a0a 2023-10-30 21:54:56,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testGetAfterCompaction' column='f1' 2023-10-30 21:54:56,932 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:54:56,933 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:54:56,939 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:54:56,941 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:54:56,949 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/a4400551695d46eda6d25e044f11388d first=Optional[r1] last=Optional[r2] 2023-10-30 21:54:56,950 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{f1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/a4400551695d46eda6d25e044f11388d}] 2023-10-30 21:54:56,950 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,950 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:56,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/a4400551695d46eda6d25e044f11388d for inclusion in 83c5fe67b72c91963deb2a6f7fe9af37/f1 2023-10-30 21:54:56,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-30 21:54:56,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:54:56,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 83c5fe67b72c91963deb2a6f7fe9af37: 2023-10-30 21:54:56,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/f1/a4400551695d46eda6d25e044f11388d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testGetAfterCompaction__qjo1kj68c3oe5ah2rp77ih9bisp9flk9js45fkl5dkupiegf4b5lp4amg9d04iig/f1/a4400551695d46eda6d25e044f11388d 2023-10-30 21:54:56,957 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-30 21:54:56,957 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-10-30 21:54:56,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testGetAfterCompaction__qjo1kj68c3oe5ah2rp77ih9bisp9flk9js45fkl5dkupiegf4b5lp4amg9d04iig/f1/a4400551695d46eda6d25e044f11388d as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_ 2023-10-30 21:54:56,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testGetAfterCompaction__qjo1kj68c3oe5ah2rp77ih9bisp9flk9js45fkl5dkupiegf4b5lp4amg9d04iig/f1/a4400551695d46eda6d25e044f11388d into 83c5fe67b72c91963deb2a6f7fe9af37/f1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_ - updating store file list. 2023-10-30 21:54:56,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_ into 83c5fe67b72c91963deb2a6f7fe9af37/f1 2023-10-30 21:54:56,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testGetAfterCompaction__qjo1kj68c3oe5ah2rp77ih9bisp9flk9js45fkl5dkupiegf4b5lp4amg9d04iig/f1/a4400551695d46eda6d25e044f11388d into 83c5fe67b72c91963deb2a6f7fe9af37/f1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_) 2023-10-30 21:54:56,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testGetAfterCompaction__qjo1kj68c3oe5ah2rp77ih9bisp9flk9js45fkl5dkupiegf4b5lp4amg9d04iig/f1/a4400551695d46eda6d25e044f11388d 2023-10-30 21:54:56,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 83c5fe67b72c91963deb2a6f7fe9af37/f1 is initiating minor compaction 2023-10-30 21:54:56,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3f2353fa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:56,965 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 83c5fe67b72c91963deb2a6f7fe9af37/f1 in testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:56,965 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/.tmp, totalSize=10.0 K 2023-10-30 21:54:56,965 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 86565ee29ca243a98965a51da432ff27, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 21:54:56,965 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 1606959983af4136a300138b167d27bb_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 21:54:56,967 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testGetAfterCompaction' column='f1' 2023-10-30 21:54:56,968 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:56,969 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023103025ac819ffd834929b1e327544a5f81ab to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023103025ac819ffd834929b1e327544a5f81ab 2023-10-30 21:54:56,971 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023103046e50dbe5d514f4ca4ccb981c77f5570 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023103046e50dbe5d514f4ca4ccb981c77f5570 2023-10-30 21:54:56,971 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-10-30 21:54:56,971 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 21:54:56,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testGetAfterCompaction' and column='f1' 2023-10-30 21:54:56,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-10-30 21:54:56,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:54:56,973 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-30 21:54:56,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 890 msec 2023-10-30 21:54:56,974 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 83c5fe67b72c91963deb2a6f7fe9af37#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:54:57,001 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,001 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,001 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,005 DEBUG [Listener at localhost/36139] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-30 21:54:57,010 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-30 21:54:57,010 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44371] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:57,011 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-10-30 21:54:57,011 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-30 21:54:57,011 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44371] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-30 21:54:57,011 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44371] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. because compaction request was cancelled 2023-10-30 21:54:57,063 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,063 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,063 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,114 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,114 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,114 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,165 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,165 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,165 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,216 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,216 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,216 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,267 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,267 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,267 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,318 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,318 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,318 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,369 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,369 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,369 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,420 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,420 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,420 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,471 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,471 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,471 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,522 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,522 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,522 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,573 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,573 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,573 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,624 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,624 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,624 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,675 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,675 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,675 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,726 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,726 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,726 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,777 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,777 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,777 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,790 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/.tmp/f1/385df817693a4ac9bb2daa51c6361be5 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/385df817693a4ac9bb2daa51c6361be5 2023-10-30 21:54:57,794 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 83c5fe67b72c91963deb2a6f7fe9af37/f1 of 83c5fe67b72c91963deb2a6f7fe9af37 into 385df817693a4ac9bb2daa51c6361be5(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:54:57,794 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 83c5fe67b72c91963deb2a6f7fe9af37: 2023-10-30 21:54:57,794 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1698702896964; duration=0sec 2023-10-30 21:54:57,794 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:54:57,828 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698702896915; access_time=1698702896102; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-30 21:54:57,828 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/385df817693a4ac9bb2daa51c6361be5; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698702897785; access_time=1698702896971; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,828 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,828 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702896072; access_time=1698702895254; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,867 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_] to archive 2023-10-30 21:54:57,867 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:54:57,869 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/86565ee29ca243a98965a51da432ff27 2023-10-30 21:54:57,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/1606959983af4136a300138b167d27bb_SeqId_12_ 2023-10-30 21:54:57,879 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/385df817693a4ac9bb2daa51c6361be5; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698702897785; access_time=1698702896971; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,879 INFO [Listener at localhost/36139] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698702895239; access_time=1698702894425; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-30 21:54:57,995 INFO [Listener at localhost/36139] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-10-30 21:54:57,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-10-30 21:54:58,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-10-30 21:54:58,007 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702898007"}]},"ts":"1698702898007"} 2023-10-30 21:54:58,008 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-10-30 21:54:58,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-30 21:54:58,011 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-10-30 21:54:58,012 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=83c5fe67b72c91963deb2a6f7fe9af37, UNASSIGN}] 2023-10-30 21:54:58,013 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=83c5fe67b72c91963deb2a6f7fe9af37, UNASSIGN 2023-10-30 21:54:58,014 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=83c5fe67b72c91963deb2a6f7fe9af37, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:58,014 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698702898014"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702898014"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702898014"}]},"ts":"1698702898014"} 2023-10-30 21:54:58,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 83c5fe67b72c91963deb2a6f7fe9af37, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:58,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-30 21:54:58,166 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:58,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:58,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 83c5fe67b72c91963deb2a6f7fe9af37, disabling compactions & flushes 2023-10-30 21:54:58,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:58,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:58,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. after waiting 0 ms 2023-10-30 21:54:58,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:58,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-30 21:54:58,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-30 21:54:58,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37. 2023-10-30 21:54:58,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 83c5fe67b72c91963deb2a6f7fe9af37: 2023-10-30 21:54:58,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:58,173 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=83c5fe67b72c91963deb2a6f7fe9af37, regionState=CLOSED 2023-10-30 21:54:58,174 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698702898173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702898173"}]},"ts":"1698702898173"} 2023-10-30 21:54:58,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-30 21:54:58,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 83c5fe67b72c91963deb2a6f7fe9af37, server=jenkins-hbase4.apache.org,44371,1698702798019 in 160 msec 2023-10-30 21:54:58,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-10-30 21:54:58,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=83c5fe67b72c91963deb2a6f7fe9af37, UNASSIGN in 164 msec 2023-10-30 21:54:58,177 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702898177"}]},"ts":"1698702898177"} 2023-10-30 21:54:58,178 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-10-30 21:54:58,182 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-10-30 21:54:58,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 183 msec 2023-10-30 21:54:58,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-30 21:54:58,311 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-10-30 21:54:58,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-10-30 21:54:58,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 21:54:58,322 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 21:54:58,324 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 21:54:58,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-30 21:54:58,327 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:58,330 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1, FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/recovered.edits] 2023-10-30 21:54:58,334 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/385df817693a4ac9bb2daa51c6361be5 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/385df817693a4ac9bb2daa51c6361be5 2023-10-30 21:54:58,336 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/f1/70d2207ef0314c399b96f67b8cdb15a2 2023-10-30 21:54:58,338 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/recovered.edits/15.seqid to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37/recovered.edits/15.seqid 2023-10-30 21:54:58,339 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testGetAfterCompaction/83c5fe67b72c91963deb2a6f7fe9af37 2023-10-30 21:54:58,339 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-30 21:54:58,339 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-30 21:54:58,340 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-10-30 21:54:58,343 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231030340a979e93a0443d9855cab04e706a0a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231030340a979e93a0443d9855cab04e706a0a 2023-10-30 21:54:58,343 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-30 21:54:58,346 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 21:54:58,367 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-10-30 21:54:58,369 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-10-30 21:54:58,370 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 21:54:58,370 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-10-30 21:54:58,370 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698702898370"}]},"ts":"9223372036854775807"} 2023-10-30 21:54:58,371 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-30 21:54:58,372 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 83c5fe67b72c91963deb2a6f7fe9af37, NAME => 'testGetAfterCompaction,,1698702892306.83c5fe67b72c91963deb2a6f7fe9af37.', STARTKEY => '', ENDKEY => ''}] 2023-10-30 21:54:58,372 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-10-30 21:54:58,372 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1698702898372"}]},"ts":"9223372036854775807"} 2023-10-30 21:54:58,373 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-10-30 21:54:58,375 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-30 21:54:58,376 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 59 msec 2023-10-30 21:54:58,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-30 21:54:58,426 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-10-30 21:54:58,439 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=247 (was 243) - Thread LEAK? -, OpenFileDescriptor=620 (was 618) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=108 (was 117), ProcessCount=167 (was 167), AvailableMemoryMB=14915 (was 14923) 2023-10-30 21:54:58,450 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=247, OpenFileDescriptor=620, MaxFileDescriptor=60000, SystemLoadAverage=108, ProcessCount=167, AvailableMemoryMB=14915 2023-10-30 21:54:58,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 21:54:58,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-10-30 21:54:58,454 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:54:58,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-10-30 21:54:58,454 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:54:58,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 21:54:58,456 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:54:58,456 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:54:58,456 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:54:58,457 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f empty. 2023-10-30 21:54:58,457 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8 empty. 2023-10-30 21:54:58,457 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f empty. 2023-10-30 21:54:58,457 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:54:58,457 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:54:58,458 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:54:58,458 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-10-30 21:54:58,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 21:54:58,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 21:54:58,867 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-30 21:54:58,868 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1463c308949ad0d3c4d75470c2b83c3f, NAME => 'testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:54:58,869 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => d2596744999eb35a27ef7cc00864b0b8, NAME => 'testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:54:58,869 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 862e3599e897d4e8a6ef63901b9c259f, NAME => 'testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:54:59,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 862e3599e897d4e8a6ef63901b9c259f, disabling compactions & flushes 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing d2596744999eb35a27ef7cc00864b0b8, disabling compactions & flushes 2023-10-30 21:54:59,283 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:54:59,283 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. after waiting 0 ms 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:59,283 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 1463c308949ad0d3c4d75470c2b83c3f, disabling compactions & flushes 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. after waiting 0 ms 2023-10-30 21:54:59,284 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:54:59,284 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:54:59,284 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. after waiting 0 ms 2023-10-30 21:54:59,284 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:54:59,283 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:54:59,284 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:54:59,284 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:54:59,284 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:54:59,284 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:54:59,284 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:54:59,286 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:54:59,286 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702899286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702899286"}]},"ts":"1698702899286"} 2023-10-30 21:54:59,287 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702899286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702899286"}]},"ts":"1698702899286"} 2023-10-30 21:54:59,287 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702899286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702899286"}]},"ts":"1698702899286"} 2023-10-30 21:54:59,288 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 21:54:59,289 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:54:59,289 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702899289"}]},"ts":"1698702899289"} 2023-10-30 21:54:59,290 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-30 21:54:59,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, ASSIGN}] 2023-10-30 21:54:59,296 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, ASSIGN 2023-10-30 21:54:59,296 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, ASSIGN 2023-10-30 21:54:59,296 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, ASSIGN 2023-10-30 21:54:59,297 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:54:59,297 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:54:59,297 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:54:59,448 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=862e3599e897d4e8a6ef63901b9c259f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:59,448 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d2596744999eb35a27ef7cc00864b0b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:59,448 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=1463c308949ad0d3c4d75470c2b83c3f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:59,448 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702899448"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702899448"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702899448"}]},"ts":"1698702899448"} 2023-10-30 21:54:59,448 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702899448"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702899448"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702899448"}]},"ts":"1698702899448"} 2023-10-30 21:54:59,448 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702899448"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702899448"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702899448"}]},"ts":"1698702899448"} 2023-10-30 21:54:59,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure 1463c308949ad0d3c4d75470c2b83c3f, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:59,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure d2596744999eb35a27ef7cc00864b0b8, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:59,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 862e3599e897d4e8a6ef63901b9c259f, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:54:59,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 21:54:59,602 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:59,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:54:59,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2596744999eb35a27ef7cc00864b0b8, NAME => 'testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 21:54:59,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:54:59,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:59,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:54:59,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:54:59,606 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:54:59,607 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1 2023-10-30 21:54:59,607 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1 2023-10-30 21:54:59,607 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2596744999eb35a27ef7cc00864b0b8 columnFamilyName family1 2023-10-30 21:54:59,608 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(310): Store=d2596744999eb35a27ef7cc00864b0b8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:59,609 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:54:59,610 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2 2023-10-30 21:54:59,610 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2 2023-10-30 21:54:59,610 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2596744999eb35a27ef7cc00864b0b8 columnFamilyName family2 2023-10-30 21:54:59,611 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(310): Store=d2596744999eb35a27ef7cc00864b0b8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:59,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:54:59,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:54:59,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:54:59,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:54:59,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:54:59,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d2596744999eb35a27ef7cc00864b0b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65647733, jitterRate=-0.02177254855632782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:54:59,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:54:59,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8., pid=84, masterSystemTime=1698702899602 2023-10-30 21:54:59,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:54:59,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:54:59,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:54:59,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 862e3599e897d4e8a6ef63901b9c259f, NAME => 'testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 21:54:59,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:54:59,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:59,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:54:59,619 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d2596744999eb35a27ef7cc00864b0b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:59,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:54:59,620 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702899619"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702899619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702899619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702899619"}]},"ts":"1698702899619"} 2023-10-30 21:54:59,621 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:54:59,622 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1 2023-10-30 21:54:59,622 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1 2023-10-30 21:54:59,622 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 862e3599e897d4e8a6ef63901b9c259f columnFamilyName family1 2023-10-30 21:54:59,622 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=81 2023-10-30 21:54:59,622 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure d2596744999eb35a27ef7cc00864b0b8, server=jenkins-hbase4.apache.org,44371,1698702798019 in 170 msec 2023-10-30 21:54:59,623 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(310): Store=862e3599e897d4e8a6ef63901b9c259f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:59,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, ASSIGN in 329 msec 2023-10-30 21:54:59,623 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:54:59,624 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2 2023-10-30 21:54:59,624 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2 2023-10-30 21:54:59,625 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 862e3599e897d4e8a6ef63901b9c259f columnFamilyName family2 2023-10-30 21:54:59,625 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(310): Store=862e3599e897d4e8a6ef63901b9c259f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:59,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:54:59,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:54:59,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:54:59,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:54:59,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:54:59,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 862e3599e897d4e8a6ef63901b9c259f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64224563, jitterRate=-0.04297943413257599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:54:59,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:54:59,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f., pid=85, masterSystemTime=1698702899602 2023-10-30 21:54:59,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:54:59,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:54:59,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:54:59,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1463c308949ad0d3c4d75470c2b83c3f, NAME => 'testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 21:54:59,632 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=862e3599e897d4e8a6ef63901b9c259f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:59,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:54:59,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:54:59,632 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702899632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702899632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702899632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702899632"}]},"ts":"1698702899632"} 2023-10-30 21:54:59,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:54:59,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:54:59,633 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:54:59,635 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1 2023-10-30 21:54:59,635 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1 2023-10-30 21:54:59,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=80 2023-10-30 21:54:59,635 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1463c308949ad0d3c4d75470c2b83c3f columnFamilyName family1 2023-10-30 21:54:59,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 862e3599e897d4e8a6ef63901b9c259f, server=jenkins-hbase4.apache.org,44371,1698702798019 in 182 msec 2023-10-30 21:54:59,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, ASSIGN in 342 msec 2023-10-30 21:54:59,636 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(310): Store=1463c308949ad0d3c4d75470c2b83c3f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:59,636 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:54:59,637 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2 2023-10-30 21:54:59,637 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2 2023-10-30 21:54:59,637 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1463c308949ad0d3c4d75470c2b83c3f columnFamilyName family2 2023-10-30 21:54:59,638 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(310): Store=1463c308949ad0d3c4d75470c2b83c3f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:54:59,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:54:59,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:54:59,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:54:59,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:54:59,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:54:59,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1463c308949ad0d3c4d75470c2b83c3f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62779513, jitterRate=-0.06451235711574554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:54:59,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:54:59,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f., pid=83, masterSystemTime=1698702899602 2023-10-30 21:54:59,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:54:59,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:54:59,650 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=1463c308949ad0d3c4d75470c2b83c3f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:54:59,650 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702899649"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702899649"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702899649"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702899649"}]},"ts":"1698702899649"} 2023-10-30 21:54:59,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=82 2023-10-30 21:54:59,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure 1463c308949ad0d3c4d75470c2b83c3f, server=jenkins-hbase4.apache.org,44371,1698702798019 in 201 msec 2023-10-30 21:54:59,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=79 2023-10-30 21:54:59,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, ASSIGN in 357 msec 2023-10-30 21:54:59,654 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:54:59,654 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702899654"}]},"ts":"1698702899654"} 2023-10-30 21:54:59,655 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-30 21:54:59,656 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:54:59,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2040 sec 2023-10-30 21:55:00,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-30 21:55:00,560 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-10-30 21:55:00,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:00,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:00,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:00,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:00,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 21:55:00,573 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 21:55:00,573 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:00,573 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 21:55:00,573 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 21:55:00,574 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:00,574 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:00,575 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:00,575 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:00,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:00,575 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:00,575 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:00,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:00,576 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 21:55:00,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 21:55:00,576 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 21:55:00,576 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:00,576 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 21:55:00,577 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:00,577 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. started... 2023-10-30 21:55:00,579 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1463c308949ad0d3c4d75470c2b83c3f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 21:55:00,579 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:00,579 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. started... 2023-10-30 21:55:00,579 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:00,579 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. started... 2023-10-30 21:55:00,579 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:00,580 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 862e3599e897d4e8a6ef63901b9c259f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 21:55:00,580 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:00,580 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d2596744999eb35a27ef7cc00864b0b8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 21:55:00,993 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310309868bd9e783b4c59889414d384e177a8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310309868bd9e783b4c59889414d384e177a8 2023-10-30 21:55:00,993 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030a89a5c2078074a9d8c4044fd11dfff1d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030a89a5c2078074a9d8c4044fd11dfff1d 2023-10-30 21:55:00,993 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030ace5696e7871475ea5952d708abd31f1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ace5696e7871475ea5952d708abd31f1 2023-10-30 21:55:01,399 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/7c9ecf62c73d4d6ebc430be45a591cd0 2023-10-30 21:55:01,399 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/fefc954e8c6f46d19febd07150946c81 2023-10-30 21:55:01,399 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/25e0c222295c4c5fa537b84ca586eec3 2023-10-30 21:55:01,815 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030228fc44195ef49d49e7d6a33fda5ba0b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030228fc44195ef49d49e7d6a33fda5ba0b 2023-10-30 21:55:01,815 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103097acfbf011da46e68a65af47202b88b8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103097acfbf011da46e68a65af47202b88b8 2023-10-30 21:55:01,816 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030435b96eb497749178314be1a625baac0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030435b96eb497749178314be1a625baac0 2023-10-30 21:55:02,220 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/b4f2d550c60a4cb387e3650dc5a4a1de 2023-10-30 21:55:02,222 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/3d9e6ecd66544295839c15e223644f4a 2023-10-30 21:55:02,222 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/a86becd250ff4d81a4e9b6cb5a2bd797 2023-10-30 21:55:02,225 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/fefc954e8c6f46d19febd07150946c81 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/fefc954e8c6f46d19febd07150946c81 2023-10-30 21:55:02,226 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/25e0c222295c4c5fa537b84ca586eec3 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/25e0c222295c4c5fa537b84ca586eec3 2023-10-30 21:55:02,226 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/7c9ecf62c73d4d6ebc430be45a591cd0 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7c9ecf62c73d4d6ebc430be45a591cd0 2023-10-30 21:55:02,229 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/fefc954e8c6f46d19febd07150946c81, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 21:55:02,230 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/25e0c222295c4c5fa537b84ca586eec3, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 21:55:02,230 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/b4f2d550c60a4cb387e3650dc5a4a1de as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/b4f2d550c60a4cb387e3650dc5a4a1de 2023-10-30 21:55:02,230 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7c9ecf62c73d4d6ebc430be45a591cd0, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 21:55:02,230 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/a86becd250ff4d81a4e9b6cb5a2bd797 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/a86becd250ff4d81a4e9b6cb5a2bd797 2023-10-30 21:55:02,231 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/3d9e6ecd66544295839c15e223644f4a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/3d9e6ecd66544295839c15e223644f4a 2023-10-30 21:55:02,234 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/a86becd250ff4d81a4e9b6cb5a2bd797, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 21:55:02,234 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/b4f2d550c60a4cb387e3650dc5a4a1de, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 21:55:02,234 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/3d9e6ecd66544295839c15e223644f4a, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 21:55:02,235 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 862e3599e897d4e8a6ef63901b9c259f in 1655ms, sequenceid=5, compaction requested=false 2023-10-30 21:55:02,235 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-30 21:55:02,235 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1463c308949ad0d3c4d75470c2b83c3f in 1656ms, sequenceid=5, compaction requested=false 2023-10-30 21:55:02,235 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-30 21:55:02,235 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d2596744999eb35a27ef7cc00864b0b8 in 1655ms, sequenceid=5, compaction requested=false 2023-10-30 21:55:02,235 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:02,236 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:02,236 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:02,236 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:02,236 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:02,236 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:02,236 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:02,236 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:02,236 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:02,236 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:02,236 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,236 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 21:55:02,236 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 21:55:02,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:02,239 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:02,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:02,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:02,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:02,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:02,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:02,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:02,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:02,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 21:55:02,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b81bfde[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:02,240 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 21:55:02,240 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:02,241 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:02,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:02,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:02,242 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 21:55:02,242 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 21:55:02,242 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:02,242 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,242 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:02,243 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,243 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 21:55:02,243 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:02,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:02,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:02,243 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 21:55:02,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:02,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:02,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:02,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:02,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:02,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:02,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 21:55:02,245 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 21:55:02,245 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:02,245 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:02,245 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 21:55:02,245 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:02,246 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:02,246 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:02,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:02,246 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:02,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:02,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:02,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:02,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:02,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:02,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:02,247 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:02,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:02,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:02,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:02,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:02,248 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:02,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:02,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,250 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,250 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:02,250 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:02,250 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:02,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 21:55:02,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:02,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:02,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:02,250 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:02,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-30 21:55:02,250 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:02,250 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,250 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:02,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:02,251 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:02,250 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:02,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:02,251 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:02,251 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:02,351 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:02,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:02,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:02,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:02,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:02,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:02,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:02,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 21:55:02,357 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 21:55:02,357 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:02,357 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 21:55:02,357 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 21:55:02,358 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:02,358 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:02,359 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,359 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:02,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:02,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:02,359 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:02,359 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:02,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:02,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:02,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:02,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:02,360 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 21:55:02,360 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 21:55:02,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 21:55:02,360 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 21:55:02,360 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:02,360 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 21:55:02,361 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:02,361 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:02,361 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. started... 2023-10-30 21:55:02,361 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. started... 2023-10-30 21:55:02,361 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d2596744999eb35a27ef7cc00864b0b8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 21:55:02,361 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1463c308949ad0d3c4d75470c2b83c3f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 21:55:02,365 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:02,365 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:02,365 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:02,365 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. started... 2023-10-30 21:55:02,365 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 862e3599e897d4e8a6ef63901b9c259f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 21:55:02,390 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030471edf7f566947818e35f240c9c822e0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030471edf7f566947818e35f240c9c822e0 2023-10-30 21:55:02,790 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030d1c13ef769d84a4c859b2e1a706c0106 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030d1c13ef769d84a4c859b2e1a706c0106 2023-10-30 21:55:02,791 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030873d8b29f6054c89b4958fdfc689eaf2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030873d8b29f6054c89b4958fdfc689eaf2 2023-10-30 21:55:02,798 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/f8e5bc52bffa4be0ae28f044f6bd38a7 2023-10-30 21:55:02,798 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/f3cf33cea1714d449a49b6b4083b47d2 2023-10-30 21:55:02,813 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310307d8175aca9684551a84b17083b5fc429 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310307d8175aca9684551a84b17083b5fc429 2023-10-30 21:55:03,198 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/52cddfc03c424c3a93ff03f86f483f45 2023-10-30 21:55:03,211 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030bb2b9df8a20c4d9d89ecf980168f4fb5 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030bb2b9df8a20c4d9d89ecf980168f4fb5 2023-10-30 21:55:03,217 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/be2278e51758412aac2c4bedd131125f 2023-10-30 21:55:03,221 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/f3cf33cea1714d449a49b6b4083b47d2 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/f3cf33cea1714d449a49b6b4083b47d2 2023-10-30 21:55:03,224 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/f3cf33cea1714d449a49b6b4083b47d2, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 21:55:03,225 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/be2278e51758412aac2c4bedd131125f as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/be2278e51758412aac2c4bedd131125f 2023-10-30 21:55:03,228 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/be2278e51758412aac2c4bedd131125f, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 21:55:03,228 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 862e3599e897d4e8a6ef63901b9c259f in 863ms, sequenceid=9, compaction requested=false 2023-10-30 21:55:03,228 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:03,228 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:03,229 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:03,613 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030e3b2d12d8e9a444eb8f6239dae7d2212 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030e3b2d12d8e9a444eb8f6239dae7d2212 2023-10-30 21:55:03,615 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/2edc474ca60f42af92614fb99dd817a4 2023-10-30 21:55:03,619 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/f8e5bc52bffa4be0ae28f044f6bd38a7 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/f8e5bc52bffa4be0ae28f044f6bd38a7 2023-10-30 21:55:03,622 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/f8e5bc52bffa4be0ae28f044f6bd38a7, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 21:55:03,623 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/2edc474ca60f42af92614fb99dd817a4 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/2edc474ca60f42af92614fb99dd817a4 2023-10-30 21:55:03,626 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/2edc474ca60f42af92614fb99dd817a4, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 21:55:03,626 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1463c308949ad0d3c4d75470c2b83c3f in 1265ms, sequenceid=9, compaction requested=false 2023-10-30 21:55:03,627 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:03,627 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:03,627 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:03,673 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:55:04,018 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/cdf2c23894004a649c1cb969397b334f 2023-10-30 21:55:04,022 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/52cddfc03c424c3a93ff03f86f483f45 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/52cddfc03c424c3a93ff03f86f483f45 2023-10-30 21:55:04,026 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/52cddfc03c424c3a93ff03f86f483f45, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 21:55:04,027 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/cdf2c23894004a649c1cb969397b334f as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/cdf2c23894004a649c1cb969397b334f 2023-10-30 21:55:04,030 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/cdf2c23894004a649c1cb969397b334f, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 21:55:04,031 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d2596744999eb35a27ef7cc00864b0b8 in 1670ms, sequenceid=9, compaction requested=false 2023-10-30 21:55:04,031 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:04,031 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:04,031 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:04,031 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:04,031 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,031 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 21:55:04,031 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 21:55:04,033 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,033 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:04,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:04,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:04,033 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:04,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:04,033 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:04,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:04,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:04,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:04,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 21:55:04,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c98b075[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:04,035 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 21:55:04,035 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:04,036 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:04,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:04,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:04,036 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 21:55:04,036 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 21:55:04,036 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,036 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:04,036 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:04,038 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 21:55:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:04,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:04,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 21:55:04,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:04,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:04,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:04,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:04,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 21:55:04,040 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 21:55:04,040 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:04,040 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:04,040 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 21:55:04,040 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:04,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:04,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:04,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:04,042 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:04,042 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:04,044 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,045 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,045 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:04,046 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:04,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 21:55:04,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:04,046 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:04,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-30 21:55:04,046 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:04,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:04,046 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:04,046 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:04,046 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,046 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:04,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:04,046 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:04,046 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:04,046 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:04,146 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:04,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:04,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:04,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:04,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:04,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:04,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:04,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 21:55:04,152 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 21:55:04,153 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:04,153 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 21:55:04,153 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 21:55:04,153 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:04,153 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:04,154 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,154 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:04,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:04,155 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:04,155 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:04,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:04,155 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 21:55:04,155 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 21:55:04,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 21:55:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 21:55:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 21:55:04,156 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:04,156 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:04,156 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:04,156 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. started... 2023-10-30 21:55:04,156 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:04,156 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. started... 2023-10-30 21:55:04,156 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d2596744999eb35a27ef7cc00864b0b8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 21:55:04,156 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. started... 2023-10-30 21:55:04,156 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 862e3599e897d4e8a6ef63901b9c259f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 21:55:04,156 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1463c308949ad0d3c4d75470c2b83c3f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 21:55:04,581 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310308dfd8cad76c847969abb2ad3b553b1c6 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310308dfd8cad76c847969abb2ad3b553b1c6 2023-10-30 21:55:04,588 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030860f6fdcac4e4aca84932618113abfe1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030860f6fdcac4e4aca84932618113abfe1 2023-10-30 21:55:04,589 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103042caf970efd942908f6eaead41f58724 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103042caf970efd942908f6eaead41f58724 2023-10-30 21:55:04,596 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/762be7ef425c4adb8ba0678817023f42 2023-10-30 21:55:04,607 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310302ca6e74fa5ed488cad98a5c4662733a8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310302ca6e74fa5ed488cad98a5c4662733a8 2023-10-30 21:55:04,989 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/8252e93ff4e24c498443225f5bae4254 2023-10-30 21:55:04,994 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/96342fde35e0477998e2cb74ead5c496 2023-10-30 21:55:05,002 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310302a7228036b84458fa693afd895ee244a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310302a7228036b84458fa693afd895ee244a 2023-10-30 21:55:05,012 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/5fe1d4c109d34d7e942430d46855ef2e 2023-10-30 21:55:05,015 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/762be7ef425c4adb8ba0678817023f42 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/762be7ef425c4adb8ba0678817023f42 2023-10-30 21:55:05,018 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/762be7ef425c4adb8ba0678817023f42, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 21:55:05,019 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/5fe1d4c109d34d7e942430d46855ef2e as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/5fe1d4c109d34d7e942430d46855ef2e 2023-10-30 21:55:05,022 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/5fe1d4c109d34d7e942430d46855ef2e, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 21:55:05,022 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1463c308949ad0d3c4d75470c2b83c3f in 866ms, sequenceid=13, compaction requested=true 2023-10-30 21:55:05,022 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:05,022 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:05,023 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:05,407 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/201b124f8783479da2db8c864e5f289d 2023-10-30 21:55:05,408 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310306dc215f23a78463581f9dde34514f935 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310306dc215f23a78463581f9dde34514f935 2023-10-30 21:55:05,411 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/8252e93ff4e24c498443225f5bae4254 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/8252e93ff4e24c498443225f5bae4254 2023-10-30 21:55:05,414 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/8252e93ff4e24c498443225f5bae4254, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 21:55:05,415 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/201b124f8783479da2db8c864e5f289d as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/201b124f8783479da2db8c864e5f289d 2023-10-30 21:55:05,419 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/201b124f8783479da2db8c864e5f289d, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 21:55:05,419 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d2596744999eb35a27ef7cc00864b0b8 in 1263ms, sequenceid=13, compaction requested=true 2023-10-30 21:55:05,420 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:05,420 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:05,420 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:05,813 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/c9c8735f2e534ab088dd64576c30a634 2023-10-30 21:55:05,818 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/96342fde35e0477998e2cb74ead5c496 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/96342fde35e0477998e2cb74ead5c496 2023-10-30 21:55:05,822 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/96342fde35e0477998e2cb74ead5c496, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 21:55:05,822 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/c9c8735f2e534ab088dd64576c30a634 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/c9c8735f2e534ab088dd64576c30a634 2023-10-30 21:55:05,828 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/c9c8735f2e534ab088dd64576c30a634, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 21:55:05,829 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 862e3599e897d4e8a6ef63901b9c259f in 1673ms, sequenceid=13, compaction requested=true 2023-10-30 21:55:05,829 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:05,829 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:05,829 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:05,829 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:05,829 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,829 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 21:55:05,829 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 21:55:05,831 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:05,831 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:05,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:05,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 21:55:05,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2be73f81[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:05,833 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 21:55:05,833 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:05,834 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:05,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:05,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:05,834 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,834 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:05,834 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 21:55:05,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 21:55:05,835 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:05,836 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 21:55:05,836 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,837 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:05,837 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 21:55:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:05,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:05,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:05,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 21:55:05,839 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 21:55:05,839 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:05,839 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:05,839 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 21:55:05,839 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:05,843 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:05,843 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:05,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:05,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:05,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:05,843 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:05,844 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:05,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:05,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:05,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:05,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:05,845 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:05,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:05,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,847 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,847 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:05,847 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:05,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:05,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 21:55:05,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:05,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:05,847 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:05,847 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:05,847 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:05,847 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,847 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:05,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:05,848 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:05,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:05,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-30 21:55:05,848 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:05,848 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:05,848 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:05,948 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:05,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:05,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:05,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:05,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:05,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:05,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:05,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 21:55:05,954 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 21:55:05,954 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:05,954 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 21:55:05,954 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 21:55:05,955 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:05,955 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:05,957 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:05,957 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:05,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:05,957 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:05,957 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:05,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:05,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:05,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:05,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:05,958 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 21:55:05,958 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-30 21:55:05,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 21:55:05,958 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 21:55:05,958 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:05,958 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 21:55:05,958 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:05,958 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. started... 2023-10-30 21:55:05,958 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:05,958 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:05,959 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. started... 2023-10-30 21:55:05,959 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1463c308949ad0d3c4d75470c2b83c3f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 21:55:05,958 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:05,959 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 862e3599e897d4e8a6ef63901b9c259f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 21:55:05,959 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. started... 2023-10-30 21:55:05,958 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:05,959 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d2596744999eb35a27ef7cc00864b0b8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 21:55:06,375 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030335dfbe58cc146a9abec0064d4917656 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030335dfbe58cc146a9abec0064d4917656 2023-10-30 21:55:06,375 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310302f5e9e1d2d3241cf82beea7105f7f320 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310302f5e9e1d2d3241cf82beea7105f7f320 2023-10-30 21:55:06,375 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310302fc7a7801fef46499a453fa979d1bbdc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310302fc7a7801fef46499a453fa979d1bbdc 2023-10-30 21:55:06,781 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/c7e80cbb09c84e6e8d7a3d577b8ed7e1 2023-10-30 21:55:06,781 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/e837304ac33d4fc5b45309196693b5b8 2023-10-30 21:55:06,781 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/18f3f89d8f024f6dae81835ea97fc9af 2023-10-30 21:55:06,957 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-30 21:55:07,200 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030478a6c01c064440eb990847a50e900d1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030478a6c01c064440eb990847a50e900d1 2023-10-30 21:55:07,202 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310306845b5365eb24fc58df86049024955ad to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310306845b5365eb24fc58df86049024955ad 2023-10-30 21:55:07,203 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030e595706124114c8bb2c6b84128f7fd99 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030e595706124114c8bb2c6b84128f7fd99 2023-10-30 21:55:07,207 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/f679d0936c2d4255a8ab3f09ec95e73f 2023-10-30 21:55:07,208 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/e1134b51c65e490fa63c1dc359f7d890 2023-10-30 21:55:07,211 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/e837304ac33d4fc5b45309196693b5b8 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e837304ac33d4fc5b45309196693b5b8 2023-10-30 21:55:07,213 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/18f3f89d8f024f6dae81835ea97fc9af as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/18f3f89d8f024f6dae81835ea97fc9af 2023-10-30 21:55:07,215 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e837304ac33d4fc5b45309196693b5b8, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 21:55:07,216 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/f679d0936c2d4255a8ab3f09ec95e73f as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/f679d0936c2d4255a8ab3f09ec95e73f 2023-10-30 21:55:07,216 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/18f3f89d8f024f6dae81835ea97fc9af, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 21:55:07,217 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/e1134b51c65e490fa63c1dc359f7d890 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/e1134b51c65e490fa63c1dc359f7d890 2023-10-30 21:55:07,219 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/f679d0936c2d4255a8ab3f09ec95e73f, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 21:55:07,220 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1463c308949ad0d3c4d75470c2b83c3f in 1261ms, sequenceid=17, compaction requested=true 2023-10-30 21:55:07,220 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:07,220 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:07,220 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:07,221 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/e1134b51c65e490fa63c1dc359f7d890, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 21:55:07,221 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d2596744999eb35a27ef7cc00864b0b8 in 1262ms, sequenceid=17, compaction requested=true 2023-10-30 21:55:07,221 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:07,221 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:07,221 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:07,606 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/50b70103991a4c42badd4983f61e02e8 2023-10-30 21:55:07,611 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/c7e80cbb09c84e6e8d7a3d577b8ed7e1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/c7e80cbb09c84e6e8d7a3d577b8ed7e1 2023-10-30 21:55:07,615 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/c7e80cbb09c84e6e8d7a3d577b8ed7e1, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 21:55:07,616 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/50b70103991a4c42badd4983f61e02e8 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/50b70103991a4c42badd4983f61e02e8 2023-10-30 21:55:07,620 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/50b70103991a4c42badd4983f61e02e8, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 21:55:07,621 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 862e3599e897d4e8a6ef63901b9c259f in 1662ms, sequenceid=17, compaction requested=true 2023-10-30 21:55:07,621 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:07,621 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:07,622 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:07,622 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:07,622 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,622 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 21:55:07,622 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 21:55:07,623 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,623 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:07,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:07,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:07,624 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:07,624 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:07,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:07,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:07,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:07,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:07,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 21:55:07,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2074b3b8[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:07,626 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 21:55:07,626 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:07,627 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:07,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:07,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:07,627 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,627 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:07,627 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 21:55:07,628 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 21:55:07,628 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:07,629 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,629 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 21:55:07,629 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:07,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:07,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:07,629 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 21:55:07,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:07,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:07,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:07,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:07,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 21:55:07,632 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 21:55:07,632 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:07,632 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:07,632 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 21:55:07,632 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:07,635 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:07,635 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:07,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:07,635 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:07,635 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:07,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:07,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:07,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:07,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:07,636 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:07,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:07,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:07,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:07,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:07,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 21:55:07,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:07,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:07,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:07,638 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:07,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:07,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-30 21:55:07,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:07,639 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:07,639 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:07,639 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:07,639 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:07,639 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:07,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:07,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:07,639 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:07,739 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:07,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:07,900 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-10-30 21:55:07,900 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:55:07,901 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6abeeaf6 to 127.0.0.1:56981 2023-10-30 21:55:07,901 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:55:07,901 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x748f84da to 127.0.0.1:56981 2023-10-30 21:55:07,901 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:55:07,901 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:55:07,901 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09b9d96a to 127.0.0.1:56981 2023-10-30 21:55:07,901 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:55:07,901 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:55:07,901 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4586f70f to 127.0.0.1:56981 2023-10-30 21:55:07,901 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:55:07,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 21:55:07,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698702907908 (current time:1698702907908). 2023-10-30 21:55:07,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-30 21:55:07,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] zookeeper.ReadOnlyZKClient(139): Connect 0x53c4f540 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:55:07,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bcbd08e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:55:07,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:55:07,922 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:55:07,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53c4f540 to 127.0.0.1:56981 2023-10-30 21:55:07,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:55:07,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-30 21:55:07,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 21:55:07,936 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot, current working dir path: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp/snaptb-1698702907740 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-30 21:55:07,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 21:55:07,947 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 21:55:07,947 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698703507947 2023-10-30 21:55:07,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 21:55:07,948 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1698702907740 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-30 21:55:07,949 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 21:55:07,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-30 21:55:07,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-10-30 21:55:07,950 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-30 21:55:07,951 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1698703507951 2023-10-30 21:55:07,953 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:07,953 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-30 21:55:08,053 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 21:55:08,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 21:55:08,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 21:55:08,057 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-30 21:55:08,257 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 21:55:08,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 21:55:08,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 21:55:08,258 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-30 21:55:08,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1698702907740 2023-10-30 21:55:08,359 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1698702907740' 2023-10-30 21:55:08,359 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-30 21:55:08,359 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1698702907740' starting 'acquire' 2023-10-30 21:55:08,359 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1698702907740', kicking off acquire phase on members. 2023-10-30 21:55:08,360 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698702907740 2023-10-30 21:55:08,360 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1698702907740 2023-10-30 21:55:08,361 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-30 21:55:08,361 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-30 21:55:08,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-30 21:55:08,361 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,361 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:08,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1698702907740 2023-10-30 21:55:08,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698702907740 2023-10-30 21:55:08,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-10-30 21:55:08,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1698702907740 2023-10-30 21:55:08,362 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1698702907740 from table testCompactionWithHFileLink type FLUSH 2023-10-30 21:55:08,365 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1698702907740 2023-10-30 21:55:08,365 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1698702907740' with timeout 300000ms 2023-10-30 21:55:08,365 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-30 21:55:08,365 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1698702907740' starting 'acquire' stage 2023-10-30 21:55:08,365 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1698702907740' locally acquired 2023-10-30 21:55:08,365 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (snaptb-1698702907740) in zk 2023-10-30 21:55:08,368 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,368 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1698702907740 2023-10-30 21:55:08,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:08,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-30 21:55:08,368 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698702907740 2023-10-30 21:55:08,368 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1698702907740' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:08,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:08,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:08,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698702907740 2023-10-30 21:55:08,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:08,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'snaptb-1698702907740' on coordinator 2023-10-30 21:55:08,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@567d8727[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:08,369 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1698702907740' starting 'in-barrier' execution. 2023-10-30 21:55:08,369 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1698702907740 2023-10-30 21:55:08,370 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698702907740 2023-10-30 21:55:08,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1698702907740 2023-10-30 21:55:08,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1698702907740 2023-10-30 21:55:08,370 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1698702907740' received 'reached' from coordinator. 2023-10-30 21:55:08,370 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,371 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:08,371 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:08,371 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:08,371 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:08,371 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-10-30 21:55:08,371 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-30 21:55:08,372 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. started... 2023-10-30 21:55:08,372 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. started... 2023-10-30 21:55:08,372 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. started... 2023-10-30 21:55:08,372 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:08,372 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:08,372 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:08,373 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.' region-info for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,373 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.' region-info for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,373 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.' region-info for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,378 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-30 21:55:08,378 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-30 21:55:08,378 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-30 21:55:08,381 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/25e0c222295c4c5fa537b84ca586eec3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/f3cf33cea1714d449a49b6b4083b47d2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/96342fde35e0477998e2cb74ead5c496, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/c7e80cbb09c84e6e8d7a3d577b8ed7e1] hfiles 2023-10-30 21:55:08,381 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7c9ecf62c73d4d6ebc430be45a591cd0, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/52cddfc03c424c3a93ff03f86f483f45, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/8252e93ff4e24c498443225f5bae4254, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/18f3f89d8f024f6dae81835ea97fc9af] hfiles 2023-10-30 21:55:08,381 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7c9ecf62c73d4d6ebc430be45a591cd0 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,381 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/fefc954e8c6f46d19febd07150946c81, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/f8e5bc52bffa4be0ae28f044f6bd38a7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/762be7ef425c4adb8ba0678817023f42, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e837304ac33d4fc5b45309196693b5b8] hfiles 2023-10-30 21:55:08,381 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/25e0c222295c4c5fa537b84ca586eec3 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,382 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/fefc954e8c6f46d19febd07150946c81 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/f8e5bc52bffa4be0ae28f044f6bd38a7 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/f3cf33cea1714d449a49b6b4083b47d2 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/52cddfc03c424c3a93ff03f86f483f45 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/96342fde35e0477998e2cb74ead5c496 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/8252e93ff4e24c498443225f5bae4254 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/762be7ef425c4adb8ba0678817023f42 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/18f3f89d8f024f6dae81835ea97fc9af for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/c7e80cbb09c84e6e8d7a3d577b8ed7e1 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e837304ac33d4fc5b45309196693b5b8 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/3d9e6ecd66544295839c15e223644f4a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/cdf2c23894004a649c1cb969397b334f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/201b124f8783479da2db8c864e5f289d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/e1134b51c65e490fa63c1dc359f7d890] hfiles 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/b4f2d550c60a4cb387e3650dc5a4a1de, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/2edc474ca60f42af92614fb99dd817a4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/5fe1d4c109d34d7e942430d46855ef2e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/f679d0936c2d4255a8ab3f09ec95e73f] hfiles 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/3d9e6ecd66544295839c15e223644f4a for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/a86becd250ff4d81a4e9b6cb5a2bd797, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/be2278e51758412aac2c4bedd131125f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/c9c8735f2e534ab088dd64576c30a634, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/50b70103991a4c42badd4983f61e02e8] hfiles 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/cdf2c23894004a649c1cb969397b334f for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/a86becd250ff4d81a4e9b6cb5a2bd797 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/201b124f8783479da2db8c864e5f289d for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/b4f2d550c60a4cb387e3650dc5a4a1de for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/e1134b51c65e490fa63c1dc359f7d890 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/be2278e51758412aac2c4bedd131125f for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/2edc474ca60f42af92614fb99dd817a4 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/c9c8735f2e534ab088dd64576c30a634 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/5fe1d4c109d34d7e942430d46855ef2e for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/f679d0936c2d4255a8ab3f09ec95e73f for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,385 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/50b70103991a4c42badd4983f61e02e8 for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,558 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 21:55:08,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 21:55:08,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 21:55:08,560 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-30 21:55:08,795 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. completed. 2023-10-30 21:55:08,795 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. completed. 2023-10-30 21:55:08,795 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:08,795 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:08,795 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. completed. 2023-10-30 21:55:08,795 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:08,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-10-30 21:55:08,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-10-30 21:55:08,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-10-30 21:55:08,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-10-30 21:55:08,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1698702907740' locally completed 2023-10-30 21:55:08,796 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1698702907740' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:08,797 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,797 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1698702907740' has notified controller of completion 2023-10-30 21:55:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,798 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-30 21:55:08,798 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1698702907740' completed. 2023-10-30 21:55:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:08,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698702907740 2023-10-30 21:55:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698702907740 2023-10-30 21:55:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1698702907740' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:08,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'snaptb-1698702907740', counting down latch. Waiting for 0 more 2023-10-30 21:55:08,800 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1698702907740' execution completed 2023-10-30 21:55:08,800 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:08,800 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:08,800 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1698702907740 2023-10-30 21:55:08,800 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1698702907740including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-30 21:55:08,802 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698702907740 2023-10-30 21:55:08,802 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698702907740 2023-10-30 21:55:08,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1698702907740 2023-10-30 21:55:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1698702907740 2023-10-30 21:55:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-30 21:55:08,802 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-30 21:55:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698702907740 2023-10-30 21:55:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:08,802 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-30 21:55:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-30 21:55:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698702907740 2023-10-30 21:55:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698702907740 2023-10-30 21:55:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698702907740 2023-10-30 21:55:08,804 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698702907740 2023-10-30 21:55:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,809 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,809 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-30 21:55:08,809 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698702907740 2023-10-30 21:55:08,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-30 21:55:08,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1698702907740 2023-10-30 21:55:08,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1698702907740 because node does not exist (not an error) 2023-10-30 21:55:08,809 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698702907740 2023-10-30 21:55:08,809 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:08,809 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-30 21:55:08,810 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698702907740/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:08,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-10-30 21:55:08,810 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698702907740 2023-10-30 21:55:08,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-30 21:55:08,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1698702907740 2023-10-30 21:55:08,810 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698702907740 2023-10-30 21:55:08,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-30 21:55:08,810 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698702907740 2023-10-30 21:55:08,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-30 21:55:08,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310302f5e9e1d2d3241cf82beea7105f7f320, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310308dfd8cad76c847969abb2ad3b553b1c6, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310309868bd9e783b4c59889414d384e177a8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030d1c13ef769d84a4c859b2e1a706c0106, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310302fc7a7801fef46499a453fa979d1bbdc, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103042caf970efd942908f6eaead41f58724, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030873d8b29f6054c89b4958fdfc689eaf2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ace5696e7871475ea5952d708abd31f1, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030335dfbe58cc146a9abec0064d4917656, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030471edf7f566947818e35f240c9c822e0, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030860f6fdcac4e4aca84932618113abfe1, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030a89a5c2078074a9d8c4044fd11dfff1d] mob files 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310302f5e9e1d2d3241cf82beea7105f7f320 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310308dfd8cad76c847969abb2ad3b553b1c6 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310309868bd9e783b4c59889414d384e177a8 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030d1c13ef769d84a4c859b2e1a706c0106 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310302fc7a7801fef46499a453fa979d1bbdc 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103042caf970efd942908f6eaead41f58724 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030873d8b29f6054c89b4958fdfc689eaf2 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ace5696e7871475ea5952d708abd31f1 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030335dfbe58cc146a9abec0064d4917656 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030471edf7f566947818e35f240c9c822e0 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030860f6fdcac4e4aca84932618113abfe1 2023-10-30 21:55:08,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030a89a5c2078074a9d8c4044fd11dfff1d 2023-10-30 21:55:08,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310302a7228036b84458fa693afd895ee244a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030435b96eb497749178314be1a625baac0, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030e3b2d12d8e9a444eb8f6239dae7d2212, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030e595706124114c8bb2c6b84128f7fd99, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310302ca6e74fa5ed488cad98a5c4662733a8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310306845b5365eb24fc58df86049024955ad, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103097acfbf011da46e68a65af47202b88b8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030bb2b9df8a20c4d9d89ecf980168f4fb5, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030228fc44195ef49d49e7d6a33fda5ba0b, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030478a6c01c064440eb990847a50e900d1, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310306dc215f23a78463581f9dde34514f935, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310307d8175aca9684551a84b17083b5fc429] mob files 2023-10-30 21:55:08,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310302a7228036b84458fa693afd895ee244a 2023-10-30 21:55:08,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030435b96eb497749178314be1a625baac0 2023-10-30 21:55:08,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030e3b2d12d8e9a444eb8f6239dae7d2212 2023-10-30 21:55:08,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030e595706124114c8bb2c6b84128f7fd99 2023-10-30 21:55:08,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310302ca6e74fa5ed488cad98a5c4662733a8 2023-10-30 21:55:08,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310306845b5365eb24fc58df86049024955ad 2023-10-30 21:55:08,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103097acfbf011da46e68a65af47202b88b8 2023-10-30 21:55:08,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030bb2b9df8a20c4d9d89ecf980168f4fb5 2023-10-30 21:55:08,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030228fc44195ef49d49e7d6a33fda5ba0b 2023-10-30 21:55:08,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030478a6c01c064440eb990847a50e900d1 2023-10-30 21:55:08,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310306dc215f23a78463581f9dde34514f935 2023-10-30 21:55:08,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310307d8175aca9684551a84b17083b5fc429 2023-10-30 21:55:09,060 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 21:55:09,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 21:55:09,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 21:55:09,061 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-30 21:55:09,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1698702907740 2023-10-30 21:55:09,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp/snaptb-1698702907740 2023-10-30 21:55:09,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp/snaptb-1698702907740 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/snaptb-1698702907740 2023-10-30 21:55:09,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1698702907740 of table testCompactionWithHFileLink completed 2023-10-30 21:55:09,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp/snaptb-1698702907740 2023-10-30 21:55:09,271 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp/snaptb-1698702907740 2023-10-30 21:55:09,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1698702907740 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698702907948Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1698702909221 (+1273 ms)Consolidate snapshot: snaptb-1698702907740 at 1698702909221Loading Region manifests for snaptb-1698702907740 at 1698702909221Writing data manifest for snaptb-1698702907740 at 1698702909231 (+10 ms)Verifying snapshot: snaptb-1698702907740 at 1698702909240 (+9 ms)Snapshot snaptb-1698702907740 of table testCompactionWithHFileLink completed at 1698702909270 (+30 ms) 2023-10-30 21:55:09,272 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-30 21:55:09,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3240 sec 2023-10-30 21:55:10,061 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 21:55:10,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 21:55:10,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-30 21:55:10,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:10,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:10,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-30 21:55:10,109 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-30 21:55:10,109 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:10,109 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-30 21:55:10,110 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-30 21:55:10,110 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:10,110 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:10,111 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:10,111 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:10,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:10,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:10,112 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:10,112 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:10,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:10,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:10,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:10,113 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-30 21:55:10,113 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-30 21:55:10,113 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-30 21:55:10,113 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:10,113 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-30 21:55:10,114 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:10,114 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. started... 2023-10-30 21:55:10,114 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:10,114 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1463c308949ad0d3c4d75470c2b83c3f 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 21:55:10,114 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:10,114 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. started... 2023-10-30 21:55:10,114 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:10,114 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:10,114 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. started... 2023-10-30 21:55:10,114 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d2596744999eb35a27ef7cc00864b0b8 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 21:55:10,114 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 862e3599e897d4e8a6ef63901b9c259f 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 21:55:10,135 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/534b54bd1cc043949ff75917a70e7848 2023-10-30 21:55:10,138 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 534b54bd1cc043949ff75917a70e7848 2023-10-30 21:55:10,937 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/7bcb77337eb34dba99255dd243aed0ff 2023-10-30 21:55:10,937 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/edd5d30bfb57496d8fbbde9b2156077b 2023-10-30 21:55:10,941 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7bcb77337eb34dba99255dd243aed0ff 2023-10-30 21:55:10,942 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for edd5d30bfb57496d8fbbde9b2156077b 2023-10-30 21:55:10,952 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/2147550d9de14a598430a0db7504ff5e 2023-10-30 21:55:10,956 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2147550d9de14a598430a0db7504ff5e 2023-10-30 21:55:10,956 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/534b54bd1cc043949ff75917a70e7848 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/534b54bd1cc043949ff75917a70e7848 2023-10-30 21:55:10,958 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/60f3a67ce85748088b6733271d5b3081 2023-10-30 21:55:10,960 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 534b54bd1cc043949ff75917a70e7848 2023-10-30 21:55:10,960 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/534b54bd1cc043949ff75917a70e7848, entries=3, sequenceid=24, filesize=5.0 K 2023-10-30 21:55:10,961 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60f3a67ce85748088b6733271d5b3081 2023-10-30 21:55:10,961 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/2147550d9de14a598430a0db7504ff5e as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/2147550d9de14a598430a0db7504ff5e 2023-10-30 21:55:10,961 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/edd5d30bfb57496d8fbbde9b2156077b as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/edd5d30bfb57496d8fbbde9b2156077b 2023-10-30 21:55:10,964 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2147550d9de14a598430a0db7504ff5e 2023-10-30 21:55:10,964 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/2147550d9de14a598430a0db7504ff5e, entries=1, sequenceid=24, filesize=5.0 K 2023-10-30 21:55:10,965 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for edd5d30bfb57496d8fbbde9b2156077b 2023-10-30 21:55:10,965 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/edd5d30bfb57496d8fbbde9b2156077b, entries=3, sequenceid=24, filesize=5.0 K 2023-10-30 21:55:10,965 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 862e3599e897d4e8a6ef63901b9c259f in 851ms, sequenceid=24, compaction requested=true 2023-10-30 21:55:10,965 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:10,965 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:10,965 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:10,965 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/60f3a67ce85748088b6733271d5b3081 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/60f3a67ce85748088b6733271d5b3081 2023-10-30 21:55:10,969 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 60f3a67ce85748088b6733271d5b3081 2023-10-30 21:55:10,969 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/60f3a67ce85748088b6733271d5b3081, entries=1, sequenceid=24, filesize=5.0 K 2023-10-30 21:55:10,969 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1463c308949ad0d3c4d75470c2b83c3f in 855ms, sequenceid=24, compaction requested=true 2023-10-30 21:55:10,969 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:10,970 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:10,970 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:11,758 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/71f69cbef7ac4d8e9c557d9aa3aed233 2023-10-30 21:55:11,762 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71f69cbef7ac4d8e9c557d9aa3aed233 2023-10-30 21:55:11,763 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/7bcb77337eb34dba99255dd243aed0ff as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7bcb77337eb34dba99255dd243aed0ff 2023-10-30 21:55:11,767 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7bcb77337eb34dba99255dd243aed0ff 2023-10-30 21:55:11,767 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7bcb77337eb34dba99255dd243aed0ff, entries=3, sequenceid=24, filesize=5.0 K 2023-10-30 21:55:11,767 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/71f69cbef7ac4d8e9c557d9aa3aed233 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/71f69cbef7ac4d8e9c557d9aa3aed233 2023-10-30 21:55:11,779 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71f69cbef7ac4d8e9c557d9aa3aed233 2023-10-30 21:55:11,779 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/71f69cbef7ac4d8e9c557d9aa3aed233, entries=1, sequenceid=24, filesize=5.0 K 2023-10-30 21:55:11,781 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d2596744999eb35a27ef7cc00864b0b8 in 1667ms, sequenceid=24, compaction requested=true 2023-10-30 21:55:11,781 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:11,781 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:11,781 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:11,781 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:11,781 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,781 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-30 21:55:11,781 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-30 21:55:11,783 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,783 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:11,783 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:11,783 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:11,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:11,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:11,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-30 21:55:11,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f9f8e85[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:11,785 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-30 21:55:11,785 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:11,792 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:11,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:11,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:11,792 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-30 21:55:11,792 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-30 21:55:11,792 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,792 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:11,792 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:11,794 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:11,794 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-30 21:55:11,794 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:11,794 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-30 21:55:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:11,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:11,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:11,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:11,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-30 21:55:11,797 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-30 21:55:11,797 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:11,797 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:11,797 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-30 21:55:11,797 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:11,798 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:11,798 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:11,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:11,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:11,798 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:11,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:11,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:11,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:11,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:11,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:11,799 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:11,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:11,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:11,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:11,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:11,800 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:11,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-30 21:55:11,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,804 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,804 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:11,804 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:11,804 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:11,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-30 21:55:11,804 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-30 21:55:11,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:11,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:11,804 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:11,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-30 21:55:11,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:11,804 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:11,804 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:11,804 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-30 21:55:11,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:11,804 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-30 21:55:11,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:11,805 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:11,805 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:11,905 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:11,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:11,906 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:11,906 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 1463c308949ad0d3c4d75470c2b83c3f/family1 is initiating major compaction (all files) 2023-10-30 21:55:11,907 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:11,907 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:11,907 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 1463c308949ad0d3c4d75470c2b83c3f/family1 in testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:11,907 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/fefc954e8c6f46d19febd07150946c81, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/f8e5bc52bffa4be0ae28f044f6bd38a7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/762be7ef425c4adb8ba0678817023f42, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e837304ac33d4fc5b45309196693b5b8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/edd5d30bfb57496d8fbbde9b2156077b] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp, totalSize=26.7 K 2023-10-30 21:55:11,908 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting fefc954e8c6f46d19febd07150946c81, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900569 2023-10-30 21:55:11,908 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting f8e5bc52bffa4be0ae28f044f6bd38a7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902353 2023-10-30 21:55:11,908 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 762be7ef425c4adb8ba0678817023f42, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:11,909 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting e837304ac33d4fc5b45309196693b5b8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:11,909 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting edd5d30bfb57496d8fbbde9b2156077b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 21:55:11,924 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 1463c308949ad0d3c4d75470c2b83c3f#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:12,334 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310308171be7dbd69418997f9f4d54c7208ca_del 2023-10-30 21:55:12,334 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310308171be7dbd69418997f9f4d54c7208ca_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310308171be7dbd69418997f9f4d54c7208ca_del 2023-10-30 21:55:12,460 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:55:13,147 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e1cf5142ce1349a0851af74b920aa99a 2023-10-30 21:55:13,147 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/e1cf5142ce1349a0851af74b920aa99a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e1cf5142ce1349a0851af74b920aa99a 2023-10-30 21:55:13,151 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e1cf5142ce1349a0851af74b920aa99a 2023-10-30 21:55:13,152 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1463c308949ad0d3c4d75470c2b83c3f/family1 of 1463c308949ad0d3c4d75470c2b83c3f into e1cf5142ce1349a0851af74b920aa99a(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:13,152 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:13,152 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:13,152 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 1463c308949ad0d3c4d75470c2b83c3f/family2 is initiating major compaction (all files) 2023-10-30 21:55:13,152 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:13,152 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:13,152 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 1463c308949ad0d3c4d75470c2b83c3f/family2 in testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:13,152 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/b4f2d550c60a4cb387e3650dc5a4a1de, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/2edc474ca60f42af92614fb99dd817a4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/5fe1d4c109d34d7e942430d46855ef2e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/f679d0936c2d4255a8ab3f09ec95e73f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/60f3a67ce85748088b6733271d5b3081] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp, totalSize=25.4 K 2023-10-30 21:55:13,153 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting b4f2d550c60a4cb387e3650dc5a4a1de, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900569 2023-10-30 21:55:13,153 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 2edc474ca60f42af92614fb99dd817a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902353 2023-10-30 21:55:13,153 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 5fe1d4c109d34d7e942430d46855ef2e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:13,153 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting f679d0936c2d4255a8ab3f09ec95e73f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:13,154 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 60f3a67ce85748088b6733271d5b3081, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 21:55:13,164 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 1463c308949ad0d3c4d75470c2b83c3f#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:13,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/fefc954e8c6f46d19febd07150946c81, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/f8e5bc52bffa4be0ae28f044f6bd38a7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/762be7ef425c4adb8ba0678817023f42, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e837304ac33d4fc5b45309196693b5b8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/edd5d30bfb57496d8fbbde9b2156077b] to archive 2023-10-30 21:55:13,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:13,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/fefc954e8c6f46d19febd07150946c81 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/fefc954e8c6f46d19febd07150946c81 2023-10-30 21:55:13,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/f8e5bc52bffa4be0ae28f044f6bd38a7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/f8e5bc52bffa4be0ae28f044f6bd38a7 2023-10-30 21:55:13,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/762be7ef425c4adb8ba0678817023f42 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/762be7ef425c4adb8ba0678817023f42 2023-10-30 21:55:13,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e837304ac33d4fc5b45309196693b5b8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e837304ac33d4fc5b45309196693b5b8 2023-10-30 21:55:13,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/edd5d30bfb57496d8fbbde9b2156077b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/edd5d30bfb57496d8fbbde9b2156077b 2023-10-30 21:55:13,573 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030b83b8611e9cc4226991d0648597e5785_del 2023-10-30 21:55:13,573 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030b83b8611e9cc4226991d0648597e5785_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030b83b8611e9cc4226991d0648597e5785_del 2023-10-30 21:55:13,994 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf1b4078553247acb1b28725c1bf6df3 2023-10-30 21:55:13,995 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/bf1b4078553247acb1b28725c1bf6df3 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/bf1b4078553247acb1b28725c1bf6df3 2023-10-30 21:55:13,999 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bf1b4078553247acb1b28725c1bf6df3 2023-10-30 21:55:14,000 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1463c308949ad0d3c4d75470c2b83c3f/family2 of 1463c308949ad0d3c4d75470c2b83c3f into bf1b4078553247acb1b28725c1bf6df3(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:55:14,000 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:14,000 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:14,000 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): d2596744999eb35a27ef7cc00864b0b8/family1 is initiating major compaction (all files) 2023-10-30 21:55:14,000 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:14,000 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:14,001 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of d2596744999eb35a27ef7cc00864b0b8/family1 in testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:14,001 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7c9ecf62c73d4d6ebc430be45a591cd0, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/52cddfc03c424c3a93ff03f86f483f45, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/8252e93ff4e24c498443225f5bae4254, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/18f3f89d8f024f6dae81835ea97fc9af, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7bcb77337eb34dba99255dd243aed0ff] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp, totalSize=26.7 K 2023-10-30 21:55:14,001 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 7c9ecf62c73d4d6ebc430be45a591cd0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900568 2023-10-30 21:55:14,002 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 52cddfc03c424c3a93ff03f86f483f45, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902353 2023-10-30 21:55:14,002 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 8252e93ff4e24c498443225f5bae4254, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:14,002 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 18f3f89d8f024f6dae81835ea97fc9af, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:14,003 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 7bcb77337eb34dba99255dd243aed0ff, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 21:55:14,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/b4f2d550c60a4cb387e3650dc5a4a1de, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/2edc474ca60f42af92614fb99dd817a4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/5fe1d4c109d34d7e942430d46855ef2e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/f679d0936c2d4255a8ab3f09ec95e73f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/60f3a67ce85748088b6733271d5b3081] to archive 2023-10-30 21:55:14,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:14,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/b4f2d550c60a4cb387e3650dc5a4a1de to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/b4f2d550c60a4cb387e3650dc5a4a1de 2023-10-30 21:55:14,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/2edc474ca60f42af92614fb99dd817a4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/2edc474ca60f42af92614fb99dd817a4 2023-10-30 21:55:14,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/5fe1d4c109d34d7e942430d46855ef2e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/5fe1d4c109d34d7e942430d46855ef2e 2023-10-30 21:55:14,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/f679d0936c2d4255a8ab3f09ec95e73f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/f679d0936c2d4255a8ab3f09ec95e73f 2023-10-30 21:55:14,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/60f3a67ce85748088b6733271d5b3081 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/60f3a67ce85748088b6733271d5b3081 2023-10-30 21:55:14,025 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): d2596744999eb35a27ef7cc00864b0b8#family1#compaction#110 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:14,045 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030929f2eca411d44a9a26991fe282e3e88_del 2023-10-30 21:55:14,046 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030929f2eca411d44a9a26991fe282e3e88_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030929f2eca411d44a9a26991fe282e3e88_del 2023-10-30 21:55:14,865 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bdeb622a7f345239e538ee2f8f2a231 2023-10-30 21:55:14,866 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/1bdeb622a7f345239e538ee2f8f2a231 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/1bdeb622a7f345239e538ee2f8f2a231 2023-10-30 21:55:14,870 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1bdeb622a7f345239e538ee2f8f2a231 2023-10-30 21:55:14,871 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d2596744999eb35a27ef7cc00864b0b8/family1 of d2596744999eb35a27ef7cc00864b0b8 into 1bdeb622a7f345239e538ee2f8f2a231(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:55:14,871 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:14,871 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:14,871 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): d2596744999eb35a27ef7cc00864b0b8/family2 is initiating major compaction (all files) 2023-10-30 21:55:14,871 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:14,871 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:14,872 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of d2596744999eb35a27ef7cc00864b0b8/family2 in testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:14,872 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/3d9e6ecd66544295839c15e223644f4a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/cdf2c23894004a649c1cb969397b334f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/201b124f8783479da2db8c864e5f289d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/e1134b51c65e490fa63c1dc359f7d890, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/71f69cbef7ac4d8e9c557d9aa3aed233] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp, totalSize=25.4 K 2023-10-30 21:55:14,872 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 3d9e6ecd66544295839c15e223644f4a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900568 2023-10-30 21:55:14,872 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting cdf2c23894004a649c1cb969397b334f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902353 2023-10-30 21:55:14,873 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 201b124f8783479da2db8c864e5f289d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:14,873 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting e1134b51c65e490fa63c1dc359f7d890, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:14,874 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 71f69cbef7ac4d8e9c557d9aa3aed233, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 21:55:14,884 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): d2596744999eb35a27ef7cc00864b0b8#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:14,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7c9ecf62c73d4d6ebc430be45a591cd0, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/52cddfc03c424c3a93ff03f86f483f45, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/8252e93ff4e24c498443225f5bae4254, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/18f3f89d8f024f6dae81835ea97fc9af, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7bcb77337eb34dba99255dd243aed0ff] to archive 2023-10-30 21:55:14,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:14,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7c9ecf62c73d4d6ebc430be45a591cd0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7c9ecf62c73d4d6ebc430be45a591cd0 2023-10-30 21:55:14,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/52cddfc03c424c3a93ff03f86f483f45 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/52cddfc03c424c3a93ff03f86f483f45 2023-10-30 21:55:14,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/8252e93ff4e24c498443225f5bae4254 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/8252e93ff4e24c498443225f5bae4254 2023-10-30 21:55:14,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/18f3f89d8f024f6dae81835ea97fc9af to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/18f3f89d8f024f6dae81835ea97fc9af 2023-10-30 21:55:14,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7bcb77337eb34dba99255dd243aed0ff to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/7bcb77337eb34dba99255dd243aed0ff 2023-10-30 21:55:15,291 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023103046c86b24a33a4a38aa6e19cee3f33249_del 2023-10-30 21:55:15,292 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103046c86b24a33a4a38aa6e19cee3f33249_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103046c86b24a33a4a38aa6e19cee3f33249_del 2023-10-30 21:55:16,105 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c30f322bd0994552b4a03aa9a7734b81 2023-10-30 21:55:16,106 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/c30f322bd0994552b4a03aa9a7734b81 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/c30f322bd0994552b4a03aa9a7734b81 2023-10-30 21:55:16,110 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c30f322bd0994552b4a03aa9a7734b81 2023-10-30 21:55:16,111 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d2596744999eb35a27ef7cc00864b0b8/family2 of d2596744999eb35a27ef7cc00864b0b8 into c30f322bd0994552b4a03aa9a7734b81(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:16,111 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:16,111 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:16,111 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 862e3599e897d4e8a6ef63901b9c259f/family1 is initiating major compaction (all files) 2023-10-30 21:55:16,111 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:16,111 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:16,111 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 862e3599e897d4e8a6ef63901b9c259f/family1 in testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:16,111 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/25e0c222295c4c5fa537b84ca586eec3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/f3cf33cea1714d449a49b6b4083b47d2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/96342fde35e0477998e2cb74ead5c496, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/c7e80cbb09c84e6e8d7a3d577b8ed7e1, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/534b54bd1cc043949ff75917a70e7848] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp, totalSize=26.7 K 2023-10-30 21:55:16,112 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 25e0c222295c4c5fa537b84ca586eec3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900566 2023-10-30 21:55:16,112 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting f3cf33cea1714d449a49b6b4083b47d2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902352 2023-10-30 21:55:16,112 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 96342fde35e0477998e2cb74ead5c496, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:16,112 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting c7e80cbb09c84e6e8d7a3d577b8ed7e1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:16,113 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 534b54bd1cc043949ff75917a70e7848, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 21:55:16,123 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 862e3599e897d4e8a6ef63901b9c259f#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:16,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/3d9e6ecd66544295839c15e223644f4a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/cdf2c23894004a649c1cb969397b334f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/201b124f8783479da2db8c864e5f289d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/e1134b51c65e490fa63c1dc359f7d890, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/71f69cbef7ac4d8e9c557d9aa3aed233] to archive 2023-10-30 21:55:16,209 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:16,210 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/3d9e6ecd66544295839c15e223644f4a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/3d9e6ecd66544295839c15e223644f4a 2023-10-30 21:55:16,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/cdf2c23894004a649c1cb969397b334f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/cdf2c23894004a649c1cb969397b334f 2023-10-30 21:55:16,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/201b124f8783479da2db8c864e5f289d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/201b124f8783479da2db8c864e5f289d 2023-10-30 21:55:16,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/e1134b51c65e490fa63c1dc359f7d890 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/e1134b51c65e490fa63c1dc359f7d890 2023-10-30 21:55:16,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/71f69cbef7ac4d8e9c557d9aa3aed233 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/71f69cbef7ac4d8e9c557d9aa3aed233 2023-10-30 21:55:16,532 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030cfb926da156c4bd3ae352119507780b0_del 2023-10-30 21:55:16,532 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030cfb926da156c4bd3ae352119507780b0_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030cfb926da156c4bd3ae352119507780b0_del 2023-10-30 21:55:17,347 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05694531f3e044d08696c3f87edfd658 2023-10-30 21:55:17,348 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/05694531f3e044d08696c3f87edfd658 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/05694531f3e044d08696c3f87edfd658 2023-10-30 21:55:17,353 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05694531f3e044d08696c3f87edfd658 2023-10-30 21:55:17,354 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 862e3599e897d4e8a6ef63901b9c259f/family1 of 862e3599e897d4e8a6ef63901b9c259f into 05694531f3e044d08696c3f87edfd658(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:17,354 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:17,354 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:17,354 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 862e3599e897d4e8a6ef63901b9c259f/family2 is initiating major compaction (all files) 2023-10-30 21:55:17,354 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:17,354 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:17,355 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 862e3599e897d4e8a6ef63901b9c259f/family2 in testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:17,355 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/a86becd250ff4d81a4e9b6cb5a2bd797, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/be2278e51758412aac2c4bedd131125f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/c9c8735f2e534ab088dd64576c30a634, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/50b70103991a4c42badd4983f61e02e8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/2147550d9de14a598430a0db7504ff5e] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp, totalSize=25.4 K 2023-10-30 21:55:17,356 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting a86becd250ff4d81a4e9b6cb5a2bd797, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900566 2023-10-30 21:55:17,356 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting be2278e51758412aac2c4bedd131125f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902352 2023-10-30 21:55:17,357 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting c9c8735f2e534ab088dd64576c30a634, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:17,357 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 50b70103991a4c42badd4983f61e02e8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:17,358 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 2147550d9de14a598430a0db7504ff5e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-30 21:55:17,370 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 862e3599e897d4e8a6ef63901b9c259f#family2#compaction#113 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:17,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/25e0c222295c4c5fa537b84ca586eec3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/f3cf33cea1714d449a49b6b4083b47d2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/96342fde35e0477998e2cb74ead5c496, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/c7e80cbb09c84e6e8d7a3d577b8ed7e1, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/534b54bd1cc043949ff75917a70e7848] to archive 2023-10-30 21:55:17,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:17,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/25e0c222295c4c5fa537b84ca586eec3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/25e0c222295c4c5fa537b84ca586eec3 2023-10-30 21:55:17,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/f3cf33cea1714d449a49b6b4083b47d2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/f3cf33cea1714d449a49b6b4083b47d2 2023-10-30 21:55:17,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/96342fde35e0477998e2cb74ead5c496 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/96342fde35e0477998e2cb74ead5c496 2023-10-30 21:55:17,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/c7e80cbb09c84e6e8d7a3d577b8ed7e1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/c7e80cbb09c84e6e8d7a3d577b8ed7e1 2023-10-30 21:55:17,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/534b54bd1cc043949ff75917a70e7848 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/534b54bd1cc043949ff75917a70e7848 2023-10-30 21:55:17,786 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030c589c01545914cfb93780968bc52bbb4_del 2023-10-30 21:55:17,786 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030c589c01545914cfb93780968bc52bbb4_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030c589c01545914cfb93780968bc52bbb4_del 2023-10-30 21:55:18,202 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0445b3ce9e5d4366808eca6a2d2e854a 2023-10-30 21:55:18,203 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/0445b3ce9e5d4366808eca6a2d2e854a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/0445b3ce9e5d4366808eca6a2d2e854a 2023-10-30 21:55:18,207 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0445b3ce9e5d4366808eca6a2d2e854a 2023-10-30 21:55:18,208 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 862e3599e897d4e8a6ef63901b9c259f/family2 of 862e3599e897d4e8a6ef63901b9c259f into 0445b3ce9e5d4366808eca6a2d2e854a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:55:18,209 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:18,216 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:18,220 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:18,226 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:18,227 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:18,233 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 21:55:18,268 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-30 21:55:18,271 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030cfb926da156c4bd3ae352119507780b0_del 2023-10-30 21:55:18,274 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030929f2eca411d44a9a26991fe282e3e88_del 2023-10-30 21:55:18,277 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310308171be7dbd69418997f9f4d54c7208ca_del 2023-10-30 21:55:18,277 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:18,278 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(139): Connect 0x79cc659a to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:55:18,282 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b3f8922, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:55:18,283 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:18,283 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:18,283 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:18,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/a86becd250ff4d81a4e9b6cb5a2bd797, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/be2278e51758412aac2c4bedd131125f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/c9c8735f2e534ab088dd64576c30a634, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/50b70103991a4c42badd4983f61e02e8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/2147550d9de14a598430a0db7504ff5e] to archive 2023-10-30 21:55:18,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:18,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/a86becd250ff4d81a4e9b6cb5a2bd797 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/a86becd250ff4d81a4e9b6cb5a2bd797 2023-10-30 21:55:18,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/be2278e51758412aac2c4bedd131125f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/be2278e51758412aac2c4bedd131125f 2023-10-30 21:55:18,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/c9c8735f2e534ab088dd64576c30a634 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/c9c8735f2e534ab088dd64576c30a634 2023-10-30 21:55:18,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/50b70103991a4c42badd4983f61e02e8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/50b70103991a4c42badd4983f61e02e8 2023-10-30 21:55:18,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/2147550d9de14a598430a0db7504ff5e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/2147550d9de14a598430a0db7504ff5e 2023-10-30 21:55:18,748 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310304505936d55d24b9fa777dcaa0b7c8275 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310304505936d55d24b9fa777dcaa0b7c8275 2023-10-30 21:55:18,749 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030b8a070c4c87c4b62a8e5be8088577cf0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030b8a070c4c87c4b62a8e5be8088577cf0 2023-10-30 21:55:18,749 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:18,749 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:18,762 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:55:18,766 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:55:18,772 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:55:18,774 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:55:18,788 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/00dfec64346b406b86033ee1b55d83f9 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-30 21:55:18,788 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/df709bb1db554a1387bfb68eec1f75a7 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-30 21:55:18,790 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/00dfec64346b406b86033ee1b55d83f9}] 2023-10-30 21:55:18,790 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/df709bb1db554a1387bfb68eec1f75a7}] 2023-10-30 21:55:18,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/df709bb1db554a1387bfb68eec1f75a7 for inclusion in 862e3599e897d4e8a6ef63901b9c259f/family1 2023-10-30 21:55:18,795 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/00dfec64346b406b86033ee1b55d83f9 for inclusion in 1463c308949ad0d3c4d75470c2b83c3f/family1 2023-10-30 21:55:18,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-30 21:55:18,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-30 21:55:18,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 21:55:18,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 21:55:18,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:18,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:18,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/00dfec64346b406b86033ee1b55d83f9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__s8asus91k02dpjsmn8db8ecvimi0a2to57177f0vltipt0g8964g46nfcdp9fevv/family1/00dfec64346b406b86033ee1b55d83f9 2023-10-30 21:55:18,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/df709bb1db554a1387bfb68eec1f75a7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__k2k3bisg7aetb119rsft3a9dqscid0m64jv13efetm02ugrer337trv09pi4evh/family1/df709bb1db554a1387bfb68eec1f75a7 2023-10-30 21:55:18,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__k2k3bisg7aetb119rsft3a9dqscid0m64jv13efetm02ugrer337trv09pi4evh/family1/df709bb1db554a1387bfb68eec1f75a7 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/435dcfb5caae4ce5b37e42c7b0af0b1f_SeqId_29_ 2023-10-30 21:55:18,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__s8asus91k02dpjsmn8db8ecvimi0a2to57177f0vltipt0g8964g46nfcdp9fevv/family1/00dfec64346b406b86033ee1b55d83f9 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/20e01385a8b84168838a5c57871b2275_SeqId_29_ 2023-10-30 21:55:18,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__k2k3bisg7aetb119rsft3a9dqscid0m64jv13efetm02ugrer337trv09pi4evh/family1/df709bb1db554a1387bfb68eec1f75a7 into 862e3599e897d4e8a6ef63901b9c259f/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/435dcfb5caae4ce5b37e42c7b0af0b1f_SeqId_29_ - updating store file list. 2023-10-30 21:55:18,802 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__s8asus91k02dpjsmn8db8ecvimi0a2to57177f0vltipt0g8964g46nfcdp9fevv/family1/00dfec64346b406b86033ee1b55d83f9 into 1463c308949ad0d3c4d75470c2b83c3f/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/20e01385a8b84168838a5c57871b2275_SeqId_29_ - updating store file list. 2023-10-30 21:55:18,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/435dcfb5caae4ce5b37e42c7b0af0b1f_SeqId_29_ into 862e3599e897d4e8a6ef63901b9c259f/family1 2023-10-30 21:55:18,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__k2k3bisg7aetb119rsft3a9dqscid0m64jv13efetm02ugrer337trv09pi4evh/family1/df709bb1db554a1387bfb68eec1f75a7 into 862e3599e897d4e8a6ef63901b9c259f/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/435dcfb5caae4ce5b37e42c7b0af0b1f_SeqId_29_) 2023-10-30 21:55:18,805 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/20e01385a8b84168838a5c57871b2275_SeqId_29_ into 1463c308949ad0d3c4d75470c2b83c3f/family1 2023-10-30 21:55:18,805 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__s8asus91k02dpjsmn8db8ecvimi0a2to57177f0vltipt0g8964g46nfcdp9fevv/family1/00dfec64346b406b86033ee1b55d83f9 into 1463c308949ad0d3c4d75470c2b83c3f/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/20e01385a8b84168838a5c57871b2275_SeqId_29_) 2023-10-30 21:55:18,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__k2k3bisg7aetb119rsft3a9dqscid0m64jv13efetm02ugrer337trv09pi4evh/family1/df709bb1db554a1387bfb68eec1f75a7 2023-10-30 21:55:18,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__s8asus91k02dpjsmn8db8ecvimi0a2to57177f0vltipt0g8964g46nfcdp9fevv/family1/00dfec64346b406b86033ee1b55d83f9 2023-10-30 21:55:18,808 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:18,808 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:18,808 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:18,808 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:18,810 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030335dfbe58cc146a9abec0064d4917656 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030335dfbe58cc146a9abec0064d4917656 2023-10-30 21:55:18,810 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310302fc7a7801fef46499a453fa979d1bbdc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310302fc7a7801fef46499a453fa979d1bbdc 2023-10-30 21:55:18,811 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030471edf7f566947818e35f240c9c822e0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030471edf7f566947818e35f240c9c822e0 2023-10-30 21:55:18,811 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103042caf970efd942908f6eaead41f58724 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023103042caf970efd942908f6eaead41f58724 2023-10-30 21:55:18,812 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030860f6fdcac4e4aca84932618113abfe1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030860f6fdcac4e4aca84932618113abfe1 2023-10-30 21:55:18,812 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030873d8b29f6054c89b4958fdfc689eaf2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030873d8b29f6054c89b4958fdfc689eaf2 2023-10-30 21:55:18,813 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030a89a5c2078074a9d8c4044fd11dfff1d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030a89a5c2078074a9d8c4044fd11dfff1d 2023-10-30 21:55:18,813 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 21:55:18,813 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ace5696e7871475ea5952d708abd31f1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231030ace5696e7871475ea5952d708abd31f1 2023-10-30 21:55:18,813 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 21:55:18,813 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 21:55:18,813 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 21:55:18,814 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:18,814 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:19,151 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310309fb9f527799c4a1782beee53c127b451 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310309fb9f527799c4a1782beee53c127b451 2023-10-30 21:55:19,152 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:19,184 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/d875301ccf3b467a92158d7ef5799bbc first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-30 21:55:19,185 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/d875301ccf3b467a92158d7ef5799bbc}] 2023-10-30 21:55:19,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/d875301ccf3b467a92158d7ef5799bbc for inclusion in d2596744999eb35a27ef7cc00864b0b8/family1 2023-10-30 21:55:19,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-30 21:55:19,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 21:55:19,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:19,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/d875301ccf3b467a92158d7ef5799bbc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__6q102dmpfgpd63lre6qpdr1eu25dqkmtjegau7qeon0lq5cokgo4e9ups8j6kk4s/family1/d875301ccf3b467a92158d7ef5799bbc 2023-10-30 21:55:19,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__6q102dmpfgpd63lre6qpdr1eu25dqkmtjegau7qeon0lq5cokgo4e9ups8j6kk4s/family1/d875301ccf3b467a92158d7ef5799bbc as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/99ab196fd3f94f10bef3fa0f79db107e_SeqId_29_ 2023-10-30 21:55:19,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__6q102dmpfgpd63lre6qpdr1eu25dqkmtjegau7qeon0lq5cokgo4e9ups8j6kk4s/family1/d875301ccf3b467a92158d7ef5799bbc into d2596744999eb35a27ef7cc00864b0b8/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/99ab196fd3f94f10bef3fa0f79db107e_SeqId_29_ - updating store file list. 2023-10-30 21:55:19,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/99ab196fd3f94f10bef3fa0f79db107e_SeqId_29_ into d2596744999eb35a27ef7cc00864b0b8/family1 2023-10-30 21:55:19,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__6q102dmpfgpd63lre6qpdr1eu25dqkmtjegau7qeon0lq5cokgo4e9ups8j6kk4s/family1/d875301ccf3b467a92158d7ef5799bbc into d2596744999eb35a27ef7cc00864b0b8/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/99ab196fd3f94f10bef3fa0f79db107e_SeqId_29_) 2023-10-30 21:55:19,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__6q102dmpfgpd63lre6qpdr1eu25dqkmtjegau7qeon0lq5cokgo4e9ups8j6kk4s/family1/d875301ccf3b467a92158d7ef5799bbc 2023-10-30 21:55:19,202 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:19,203 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:19,204 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310302f5e9e1d2d3241cf82beea7105f7f320 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310302f5e9e1d2d3241cf82beea7105f7f320 2023-10-30 21:55:19,205 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310308dfd8cad76c847969abb2ad3b553b1c6 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310308dfd8cad76c847969abb2ad3b553b1c6 2023-10-30 21:55:19,206 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310309868bd9e783b4c59889414d384e177a8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310309868bd9e783b4c59889414d384e177a8 2023-10-30 21:55:19,207 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030d1c13ef769d84a4c859b2e1a706c0106 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030d1c13ef769d84a4c859b2e1a706c0106 2023-10-30 21:55:19,207 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 21:55:19,207 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 21:55:19,208 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:19,208 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:19,208 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:19,208 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030cfb926da156c4bd3ae352119507780b0_del] 2023-10-30 21:55:19,208 DEBUG [Listener at localhost/36139] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:19,209 DEBUG [Listener at localhost/36139] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030cfb926da156c4bd3ae352119507780b0_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030cfb926da156c4bd3ae352119507780b0_del 2023-10-30 21:55:19,210 INFO [Listener at localhost/36139] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-30 21:55:19,210 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030929f2eca411d44a9a26991fe282e3e88_del] 2023-10-30 21:55:19,210 DEBUG [Listener at localhost/36139] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:19,211 DEBUG [Listener at localhost/36139] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030929f2eca411d44a9a26991fe282e3e88_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030929f2eca411d44a9a26991fe282e3e88_del 2023-10-30 21:55:19,211 INFO [Listener at localhost/36139] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-30 21:55:19,211 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310308171be7dbd69418997f9f4d54c7208ca_del] 2023-10-30 21:55:19,212 DEBUG [Listener at localhost/36139] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:19,213 DEBUG [Listener at localhost/36139] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310308171be7dbd69418997f9f4d54c7208ca_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310308171be7dbd69418997f9f4d54c7208ca_del 2023-10-30 21:55:19,213 INFO [Listener at localhost/36139] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-30 21:55:19,215 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:19,217 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:19,221 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:19,222 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:19,227 INFO [Listener at localhost/36139] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-10-30 21:55:19,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-10-30 21:55:19,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-10-30 21:55:19,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-30 21:55:19,231 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702919231"}]},"ts":"1698702919231"} 2023-10-30 21:55:19,232 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-10-30 21:55:19,233 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-10-30 21:55:19,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, UNASSIGN}] 2023-10-30 21:55:19,235 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, UNASSIGN 2023-10-30 21:55:19,235 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, UNASSIGN 2023-10-30 21:55:19,235 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, UNASSIGN 2023-10-30 21:55:19,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=d2596744999eb35a27ef7cc00864b0b8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:19,236 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=862e3599e897d4e8a6ef63901b9c259f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:19,236 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1463c308949ad0d3c4d75470c2b83c3f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:19,236 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702919236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702919236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702919236"}]},"ts":"1698702919236"} 2023-10-30 21:55:19,236 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702919236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702919236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702919236"}]},"ts":"1698702919236"} 2023-10-30 21:55:19,236 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702919236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702919236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702919236"}]},"ts":"1698702919236"} 2023-10-30 21:55:19,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure d2596744999eb35a27ef7cc00864b0b8, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:19,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 1463c308949ad0d3c4d75470c2b83c3f, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:19,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 862e3599e897d4e8a6ef63901b9c259f, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:19,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-30 21:55:19,389 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:19,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:19,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 862e3599e897d4e8a6ef63901b9c259f, disabling compactions & flushes 2023-10-30 21:55:19,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:19,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:19,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. after waiting 0 ms 2023-10-30 21:55:19,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:19,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-30 21:55:19,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:19,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:19,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:19,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:19,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1463c308949ad0d3c4d75470c2b83c3f, disabling compactions & flushes 2023-10-30 21:55:19,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:19,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:19,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. after waiting 0 ms 2023-10-30 21:55:19,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:19,397 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=862e3599e897d4e8a6ef63901b9c259f, regionState=CLOSED 2023-10-30 21:55:19,397 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702919397"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702919397"}]},"ts":"1698702919397"} 2023-10-30 21:55:19,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=89 2023-10-30 21:55:19,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 862e3599e897d4e8a6ef63901b9c259f, server=jenkins-hbase4.apache.org,44371,1698702798019 in 160 msec 2023-10-30 21:55:19,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, UNASSIGN in 166 msec 2023-10-30 21:55:19,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-30 21:55:19,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:19,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:19,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:19,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:19,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d2596744999eb35a27ef7cc00864b0b8, disabling compactions & flushes 2023-10-30 21:55:19,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:19,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:19,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. after waiting 0 ms 2023-10-30 21:55:19,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:19,403 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1463c308949ad0d3c4d75470c2b83c3f, regionState=CLOSED 2023-10-30 21:55:19,404 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702919403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702919403"}]},"ts":"1698702919403"} 2023-10-30 21:55:19,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-30 21:55:19,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure 1463c308949ad0d3c4d75470c2b83c3f, server=jenkins-hbase4.apache.org,44371,1698702798019 in 167 msec 2023-10-30 21:55:19,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, UNASSIGN in 172 msec 2023-10-30 21:55:19,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-30 21:55:19,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:19,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:19,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:19,410 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=d2596744999eb35a27ef7cc00864b0b8, regionState=CLOSED 2023-10-30 21:55:19,410 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702919410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702919410"}]},"ts":"1698702919410"} 2023-10-30 21:55:19,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-30 21:55:19,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure d2596744999eb35a27ef7cc00864b0b8, server=jenkins-hbase4.apache.org,44371,1698702798019 in 174 msec 2023-10-30 21:55:19,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=90, resume processing ppid=88 2023-10-30 21:55:19,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, UNASSIGN in 178 msec 2023-10-30 21:55:19,414 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702919414"}]},"ts":"1698702919414"} 2023-10-30 21:55:19,414 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-10-30 21:55:19,416 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-10-30 21:55:19,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 188 msec 2023-10-30 21:55:19,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-30 21:55:19,532 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-10-30 21:55:19,542 INFO [Listener at localhost/36139] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1698702907740-1698702919542 2023-10-30 21:55:19,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 21:55:19,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698702919543 (current time:1698702919543). 2023-10-30 21:55:19,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-30 21:55:19,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] zookeeper.ReadOnlyZKClient(139): Connect 0x2c254aa3 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:55:19,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bcc52af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:55:19,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:55:19,551 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:55:19,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c254aa3 to 127.0.0.1:56981 2023-10-30 21:55:19,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:55:19,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-30 21:55:19,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 21:55:19,554 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot, current working dir path: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698702907740-1698702919542 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-30 21:55:19,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 21:55:19,556 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 21:55:19,557 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698703519557 2023-10-30 21:55:19,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1698702907740-1698702919542 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-30 21:55:19,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 21:55:19,557 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:19,558 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-30 21:55:19,658 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 21:55:19,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 21:55:19,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 21:55:19,659 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-30 21:55:19,859 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 21:55:19,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 21:55:19,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 21:55:19,860 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-30 21:55:19,964 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-10-30 21:55:19,965 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 21:55:19,965 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 21:55:19,965 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 21:55:19,965 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-30 21:55:19,965 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 21:55:19,965 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 21:55:19,965 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 21:55:19,966 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-30 21:55:19,968 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/1bdeb622a7f345239e538ee2f8f2a231, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/99ab196fd3f94f10bef3fa0f79db107e_SeqId_29_] hfiles 2023-10-30 21:55:19,968 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/1bdeb622a7f345239e538ee2f8f2a231 2023-10-30 21:55:19,968 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/99ab196fd3f94f10bef3fa0f79db107e_SeqId_29_ 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/05694531f3e044d08696c3f87edfd658, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/435dcfb5caae4ce5b37e42c7b0af0b1f_SeqId_29_] hfiles 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/05694531f3e044d08696c3f87edfd658 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/435dcfb5caae4ce5b37e42c7b0af0b1f_SeqId_29_ 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/20e01385a8b84168838a5c57871b2275_SeqId_29_, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e1cf5142ce1349a0851af74b920aa99a] hfiles 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310309fb9f527799c4a1782beee53c127b451, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310304505936d55d24b9fa777dcaa0b7c8275, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030b8a070c4c87c4b62a8e5be8088577cf0] hfiles 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/20e01385a8b84168838a5c57871b2275_SeqId_29_ 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310309fb9f527799c4a1782beee53c127b451 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e1cf5142ce1349a0851af74b920aa99a 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/c30f322bd0994552b4a03aa9a7734b81] hfiles 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310304505936d55d24b9fa777dcaa0b7c8275 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/c30f322bd0994552b4a03aa9a7734b81 2023-10-30 21:55:19,969 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030b8a070c4c87c4b62a8e5be8088577cf0 2023-10-30 21:55:19,970 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/0445b3ce9e5d4366808eca6a2d2e854a] hfiles 2023-10-30 21:55:19,970 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/0445b3ce9e5d4366808eca6a2d2e854a 2023-10-30 21:55:19,970 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/bf1b4078553247acb1b28725c1bf6df3] hfiles 2023-10-30 21:55:19,970 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/bf1b4078553247acb1b28725c1bf6df3 2023-10-30 21:55:19,981 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310302a7228036b84458fa693afd895ee244a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030435b96eb497749178314be1a625baac0, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103046c86b24a33a4a38aa6e19cee3f33249_del, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030e3b2d12d8e9a444eb8f6239dae7d2212, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030e595706124114c8bb2c6b84128f7fd99, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310302ca6e74fa5ed488cad98a5c4662733a8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310306845b5365eb24fc58df86049024955ad, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103097acfbf011da46e68a65af47202b88b8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030b83b8611e9cc4226991d0648597e5785_del, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030bb2b9df8a20c4d9d89ecf980168f4fb5, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030228fc44195ef49d49e7d6a33fda5ba0b, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030478a6c01c064440eb990847a50e900d1, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310306dc215f23a78463581f9dde34514f935, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310307d8175aca9684551a84b17083b5fc429, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030c589c01545914cfb93780968bc52bbb4_del] hfiles 2023-10-30 21:55:19,981 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310302a7228036b84458fa693afd895ee244a 2023-10-30 21:55:19,981 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030435b96eb497749178314be1a625baac0 2023-10-30 21:55:19,981 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103046c86b24a33a4a38aa6e19cee3f33249_del 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030e3b2d12d8e9a444eb8f6239dae7d2212 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231030e595706124114c8bb2c6b84128f7fd99 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310302ca6e74fa5ed488cad98a5c4662733a8 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310306845b5365eb24fc58df86049024955ad 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023103097acfbf011da46e68a65af47202b88b8 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030b83b8611e9cc4226991d0648597e5785_del 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030bb2b9df8a20c4d9d89ecf980168f4fb5 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030228fc44195ef49d49e7d6a33fda5ba0b 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030478a6c01c064440eb990847a50e900d1 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310306dc215f23a78463581f9dde34514f935 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310307d8175aca9684551a84b17083b5fc429 2023-10-30 21:55:19,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030c589c01545914cfb93780968bc52bbb4_del 2023-10-30 21:55:20,160 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 21:55:20,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 21:55:20,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 21:55:20,162 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-30 21:55:20,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-10-30 21:55:20,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1698702907740-1698702919542 2023-10-30 21:55:20,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698702907740-1698702919542 2023-10-30 21:55:20,662 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 21:55:20,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 21:55:20,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-30 21:55:20,664 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-30 21:55:20,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698702907740-1698702919542 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/hbase-failsafe-snaptb-1698702907740-1698702919542 2023-10-30 21:55:20,824 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1698702907740-1698702919542 of table testCompactionWithHFileLink completed 2023-10-30 21:55:20,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698702907740-1698702919542 2023-10-30 21:55:20,825 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698702907740-1698702919542 2023-10-30 21:55:20,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1698702907740-1698702919542 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698702919557Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1698702919964 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1698702907740-1698702919542 at 1698702920394 (+430 ms)Loading Region manifests for hbase-failsafe-snaptb-1698702907740-1698702919542 at 1698702920394Writing data manifest for hbase-failsafe-snaptb-1698702907740-1698702919542 at 1698702920397 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1698702907740-1698702919542 at 1698702920803 (+406 ms)Snapshot hbase-failsafe-snaptb-1698702907740-1698702919542 of table testCompactionWithHFileLink completed at 1698702920824 (+21 ms) 2023-10-30 21:55:20,826 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-30 21:55:20,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2710 sec 2023-10-30 21:55:21,664 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-30 21:55:21,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-30 21:55:21,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1698702907740-1698702919542 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-30 21:55:21,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698702907740" table: "testCompactionWithHFileLink" creation_time: 1698702907908 type: FLUSH version: 2 ttl: 0 ) 2023-10-30 21:55:21,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1698702907740 as table=testCompactionWithHFileLink 2023-10-30 21:55:21,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 21:55:21,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 21:55:22,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 21:55:22,121 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-30 21:55:22,122 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-30 21:55:22,122 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-30 21:55:22,122 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-30 21:55:22,127 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1698702907740" table: "testCompactionWithHFileLink" creation_time: 1698702907908 type: FLUSH version: 2 ttl: 0 2023-10-30 21:55:22,128 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink 2023-10-30 21:55:22,132 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-10-30 21:55:22,136 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310309fb9f527799c4a1782beee53c127b451 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310309fb9f527799c4a1782beee53c127b451 2023-10-30 21:55:22,137 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030b8a070c4c87c4b62a8e5be8088577cf0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030b8a070c4c87c4b62a8e5be8088577cf0 2023-10-30 21:55:22,139 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310304505936d55d24b9fa777dcaa0b7c8275 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310304505936d55d24b9fa777dcaa0b7c8275 2023-10-30 21:55:22,139 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310302f5e9e1d2d3241cf82beea7105f7f320 of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,142 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310308dfd8cad76c847969abb2ad3b553b1c6 of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,146 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310309868bd9e783b4c59889414d384e177a8 of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,149 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231030d1c13ef769d84a4c859b2e1a706c0106 of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,152 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310302fc7a7801fef46499a453fa979d1bbdc of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,155 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023103042caf970efd942908f6eaead41f58724 of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,159 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231030873d8b29f6054c89b4958fdfc689eaf2 of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,162 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231030ace5696e7871475ea5952d708abd31f1 of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,165 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231030335dfbe58cc146a9abec0064d4917656 of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,168 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231030471edf7f566947818e35f240c9c822e0 of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,171 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231030860f6fdcac4e4aca84932618113abfe1 of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,175 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231030a89a5c2078074a9d8c4044fd11dfff1d of snapshot=snaptb-1698702907740 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-30 21:55:22,180 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030c589c01545914cfb93780968bc52bbb4_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231030c589c01545914cfb93780968bc52bbb4_del 2023-10-30 21:55:22,181 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030b83b8611e9cc4226991d0648597e5785_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231030b83b8611e9cc4226991d0648597e5785_del 2023-10-30 21:55:22,182 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103046c86b24a33a4a38aa6e19cee3f33249_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023103046c86b24a33a4a38aa6e19cee3f33249_del 2023-10-30 21:55:22,182 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:22,183 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:22,183 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:22,188 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e1cf5142ce1349a0851af74b920aa99a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/e1cf5142ce1349a0851af74b920aa99a 2023-10-30 21:55:22,188 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/1bdeb622a7f345239e538ee2f8f2a231 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/1bdeb622a7f345239e538ee2f8f2a231 2023-10-30 21:55:22,188 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/05694531f3e044d08696c3f87edfd658 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/05694531f3e044d08696c3f87edfd658 2023-10-30 21:55:22,190 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/20e01385a8b84168838a5c57871b2275_SeqId_29_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/20e01385a8b84168838a5c57871b2275_SeqId_29_ 2023-10-30 21:55:22,190 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fefc954e8c6f46d19febd07150946c81 of snapshot=snaptb-1698702907740 to region=1463c308949ad0d3c4d75470c2b83c3f table=testCompactionWithHFileLink 2023-10-30 21:55:22,190 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/99ab196fd3f94f10bef3fa0f79db107e_SeqId_29_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/99ab196fd3f94f10bef3fa0f79db107e_SeqId_29_ 2023-10-30 21:55:22,190 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/435dcfb5caae4ce5b37e42c7b0af0b1f_SeqId_29_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/435dcfb5caae4ce5b37e42c7b0af0b1f_SeqId_29_ 2023-10-30 21:55:22,190 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7c9ecf62c73d4d6ebc430be45a591cd0 of snapshot=snaptb-1698702907740 to region=d2596744999eb35a27ef7cc00864b0b8 table=testCompactionWithHFileLink 2023-10-30 21:55:22,190 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 25e0c222295c4c5fa537b84ca586eec3 of snapshot=snaptb-1698702907740 to region=862e3599e897d4e8a6ef63901b9c259f table=testCompactionWithHFileLink 2023-10-30 21:55:22,205 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f8e5bc52bffa4be0ae28f044f6bd38a7 of snapshot=snaptb-1698702907740 to region=1463c308949ad0d3c4d75470c2b83c3f table=testCompactionWithHFileLink 2023-10-30 21:55:22,206 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f3cf33cea1714d449a49b6b4083b47d2 of snapshot=snaptb-1698702907740 to region=862e3599e897d4e8a6ef63901b9c259f table=testCompactionWithHFileLink 2023-10-30 21:55:22,206 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 52cddfc03c424c3a93ff03f86f483f45 of snapshot=snaptb-1698702907740 to region=d2596744999eb35a27ef7cc00864b0b8 table=testCompactionWithHFileLink 2023-10-30 21:55:22,210 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 762be7ef425c4adb8ba0678817023f42 of snapshot=snaptb-1698702907740 to region=1463c308949ad0d3c4d75470c2b83c3f table=testCompactionWithHFileLink 2023-10-30 21:55:22,210 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 96342fde35e0477998e2cb74ead5c496 of snapshot=snaptb-1698702907740 to region=862e3599e897d4e8a6ef63901b9c259f table=testCompactionWithHFileLink 2023-10-30 21:55:22,211 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8252e93ff4e24c498443225f5bae4254 of snapshot=snaptb-1698702907740 to region=d2596744999eb35a27ef7cc00864b0b8 table=testCompactionWithHFileLink 2023-10-30 21:55:22,215 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e837304ac33d4fc5b45309196693b5b8 of snapshot=snaptb-1698702907740 to region=1463c308949ad0d3c4d75470c2b83c3f table=testCompactionWithHFileLink 2023-10-30 21:55:22,216 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c7e80cbb09c84e6e8d7a3d577b8ed7e1 of snapshot=snaptb-1698702907740 to region=862e3599e897d4e8a6ef63901b9c259f table=testCompactionWithHFileLink 2023-10-30 21:55:22,218 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 18f3f89d8f024f6dae81835ea97fc9af of snapshot=snaptb-1698702907740 to region=d2596744999eb35a27ef7cc00864b0b8 table=testCompactionWithHFileLink 2023-10-30 21:55:22,223 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/0445b3ce9e5d4366808eca6a2d2e854a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/0445b3ce9e5d4366808eca6a2d2e854a 2023-10-30 21:55:22,223 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a86becd250ff4d81a4e9b6cb5a2bd797 of snapshot=snaptb-1698702907740 to region=862e3599e897d4e8a6ef63901b9c259f table=testCompactionWithHFileLink 2023-10-30 21:55:22,225 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/c30f322bd0994552b4a03aa9a7734b81 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/c30f322bd0994552b4a03aa9a7734b81 2023-10-30 21:55:22,225 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3d9e6ecd66544295839c15e223644f4a of snapshot=snaptb-1698702907740 to region=d2596744999eb35a27ef7cc00864b0b8 table=testCompactionWithHFileLink 2023-10-30 21:55:22,227 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/bf1b4078553247acb1b28725c1bf6df3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/bf1b4078553247acb1b28725c1bf6df3 2023-10-30 21:55:22,227 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b4f2d550c60a4cb387e3650dc5a4a1de of snapshot=snaptb-1698702907740 to region=1463c308949ad0d3c4d75470c2b83c3f table=testCompactionWithHFileLink 2023-10-30 21:55:22,230 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink be2278e51758412aac2c4bedd131125f of snapshot=snaptb-1698702907740 to region=862e3599e897d4e8a6ef63901b9c259f table=testCompactionWithHFileLink 2023-10-30 21:55:22,231 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cdf2c23894004a649c1cb969397b334f of snapshot=snaptb-1698702907740 to region=d2596744999eb35a27ef7cc00864b0b8 table=testCompactionWithHFileLink 2023-10-30 21:55:22,233 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2edc474ca60f42af92614fb99dd817a4 of snapshot=snaptb-1698702907740 to region=1463c308949ad0d3c4d75470c2b83c3f table=testCompactionWithHFileLink 2023-10-30 21:55:22,235 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c9c8735f2e534ab088dd64576c30a634 of snapshot=snaptb-1698702907740 to region=862e3599e897d4e8a6ef63901b9c259f table=testCompactionWithHFileLink 2023-10-30 21:55:22,236 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 201b124f8783479da2db8c864e5f289d of snapshot=snaptb-1698702907740 to region=d2596744999eb35a27ef7cc00864b0b8 table=testCompactionWithHFileLink 2023-10-30 21:55:22,237 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5fe1d4c109d34d7e942430d46855ef2e of snapshot=snaptb-1698702907740 to region=1463c308949ad0d3c4d75470c2b83c3f table=testCompactionWithHFileLink 2023-10-30 21:55:22,239 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 50b70103991a4c42badd4983f61e02e8 of snapshot=snaptb-1698702907740 to region=862e3599e897d4e8a6ef63901b9c259f table=testCompactionWithHFileLink 2023-10-30 21:55:22,240 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e1134b51c65e490fa63c1dc359f7d890 of snapshot=snaptb-1698702907740 to region=d2596744999eb35a27ef7cc00864b0b8 table=testCompactionWithHFileLink 2023-10-30 21:55:22,241 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f679d0936c2d4255a8ab3f09ec95e73f of snapshot=snaptb-1698702907740 to region=1463c308949ad0d3c4d75470c2b83c3f table=testCompactionWithHFileLink 2023-10-30 21:55:22,253 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1698702907740" table: "testCompactionWithHFileLink" creation_time: 1698702907908 type: FLUSH version: 2 ttl: 0 2023-10-30 21:55:22,255 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698702922255"}]},"ts":"9223372036854775807"} 2023-10-30 21:55:22,255 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698702922255"}]},"ts":"9223372036854775807"} 2023-10-30 21:55:22,255 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698702922255"}]},"ts":"9223372036854775807"} 2023-10-30 21:55:22,257 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-10-30 21:55:22,257 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1463c308949ad0d3c4d75470c2b83c3f, NAME => 'testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 862e3599e897d4e8a6ef63901b9c259f, NAME => 'testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d2596744999eb35a27ef7cc00864b0b8, NAME => 'testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.', STARTKEY => '1', ENDKEY => '2'}] 2023-10-30 21:55:22,257 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702922256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702922256"}]},"ts":"1698702922256"} 2023-10-30 21:55:22,257 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702922256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702922256"}]},"ts":"1698702922256"} 2023-10-30 21:55:22,257 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702922256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702922256"}]},"ts":"1698702922256"} 2023-10-30 21:55:22,259 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 21:55:22,259 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-10-30 21:55:22,259 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 1463c308949ad0d3c4d75470c2b83c3f, NAME => 'testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 862e3599e897d4e8a6ef63901b9c259f, NAME => 'testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d2596744999eb35a27ef7cc00864b0b8, NAME => 'testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.', STARTKEY => '1', ENDKEY => '2'}] 2023-10-30 21:55:22,260 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1698702907740 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-10-30 21:55:22,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698702907740" table: "testCompactionWithHFileLink" creation_time: 1698702907908 type: FLUSH version: 2 ttl: 0 ) in 560 msec 2023-10-30 21:55:22,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-30 21:55:22,316 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-10-30 21:55:22,316 INFO [Listener at localhost/36139] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1698702907740-1698702919542 2023-10-30 21:55:22,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1698702907740-1698702919542" 2023-10-30 21:55:22,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1698702907740-1698702919542 2023-10-30 21:55:22,326 INFO [Listener at localhost/36139] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-10-30 21:55:22,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-10-30 21:55:22,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-10-30 21:55:22,338 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-10-30 21:55:22,338 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702922338"}]},"ts":"1698702922338"} 2023-10-30 21:55:22,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 21:55:22,339 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-30 21:55:22,341 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-10-30 21:55:22,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, ASSIGN}] 2023-10-30 21:55:22,343 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, ASSIGN 2023-10-30 21:55:22,343 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, ASSIGN 2023-10-30 21:55:22,343 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, ASSIGN 2023-10-30 21:55:22,343 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-30 21:55:22,343 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-30 21:55:22,344 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-30 21:55:22,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 21:55:22,495 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=d2596744999eb35a27ef7cc00864b0b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:22,495 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=862e3599e897d4e8a6ef63901b9c259f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:22,495 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1463c308949ad0d3c4d75470c2b83c3f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:22,495 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702922495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702922495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702922495"}]},"ts":"1698702922495"} 2023-10-30 21:55:22,495 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702922495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702922495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702922495"}]},"ts":"1698702922495"} 2023-10-30 21:55:22,495 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702922495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702922495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702922495"}]},"ts":"1698702922495"} 2023-10-30 21:55:22,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure d2596744999eb35a27ef7cc00864b0b8, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:22,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 1463c308949ad0d3c4d75470c2b83c3f, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:22,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 862e3599e897d4e8a6ef63901b9c259f, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:22,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 21:55:22,649 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:22,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:22,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d2596744999eb35a27ef7cc00864b0b8, NAME => 'testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 21:55:22,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:22,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:22,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:22,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:22,653 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:22,654 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1 2023-10-30 21:55:22,654 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1 2023-10-30 21:55:22,655 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2596744999eb35a27ef7cc00864b0b8 columnFamilyName family1 2023-10-30 21:55:22,664 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-18f3f89d8f024f6dae81835ea97fc9af 2023-10-30 21:55:22,669 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-52cddfc03c424c3a93ff03f86f483f45 2023-10-30 21:55:22,674 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-7c9ecf62c73d4d6ebc430be45a591cd0 2023-10-30 21:55:22,679 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-8252e93ff4e24c498443225f5bae4254 2023-10-30 21:55:22,679 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(310): Store=d2596744999eb35a27ef7cc00864b0b8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:22,680 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:22,680 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2 2023-10-30 21:55:22,680 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2 2023-10-30 21:55:22,681 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d2596744999eb35a27ef7cc00864b0b8 columnFamilyName family2 2023-10-30 21:55:22,690 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-201b124f8783479da2db8c864e5f289d 2023-10-30 21:55:22,696 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-3d9e6ecd66544295839c15e223644f4a 2023-10-30 21:55:22,701 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-cdf2c23894004a649c1cb969397b334f 2023-10-30 21:55:22,706 DEBUG [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-e1134b51c65e490fa63c1dc359f7d890 2023-10-30 21:55:22,706 INFO [StoreOpener-d2596744999eb35a27ef7cc00864b0b8-1] regionserver.HStore(310): Store=d2596744999eb35a27ef7cc00864b0b8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:22,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:22,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:22,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:55:22,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:55:22,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d2596744999eb35a27ef7cc00864b0b8; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66129614, jitterRate=-0.014591962099075317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:55:22,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:22,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8., pid=101, masterSystemTime=1698702922649 2023-10-30 21:55:22,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:55:22,714 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 21:55:22,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 21:55:22,715 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 21:55:22,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:22,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:22,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:22,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1463c308949ad0d3c4d75470c2b83c3f, NAME => 'testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 21:55:22,717 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=d2596744999eb35a27ef7cc00864b0b8, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:22,717 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702922717"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702922717"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702922717"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702922717"}]},"ts":"1698702922717"} 2023-10-30 21:55:22,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:22,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:22,719 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 21:55:22,719 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HStore(1912): d2596744999eb35a27ef7cc00864b0b8/family2 is initiating minor compaction (all files) 2023-10-30 21:55:22,719 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegion(2259): Starting compaction of d2596744999eb35a27ef7cc00864b0b8/family2 in testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:22,719 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-3d9e6ecd66544295839c15e223644f4a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-cdf2c23894004a649c1cb969397b334f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-201b124f8783479da2db8c864e5f289d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-e1134b51c65e490fa63c1dc359f7d890] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp, totalSize=20.4 K 2023-10-30 21:55:22,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:22,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:22,720 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-3d9e6ecd66544295839c15e223644f4a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900568 2023-10-30 21:55:22,720 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 21:55:22,721 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1912): d2596744999eb35a27ef7cc00864b0b8/family1 is initiating minor compaction (all files) 2023-10-30 21:55:22,721 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d2596744999eb35a27ef7cc00864b0b8/family1 in testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:55:22,721 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-7c9ecf62c73d4d6ebc430be45a591cd0, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-52cddfc03c424c3a93ff03f86f483f45, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-8252e93ff4e24c498443225f5bae4254, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-18f3f89d8f024f6dae81835ea97fc9af] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp, totalSize=21.6 K 2023-10-30 21:55:22,720 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-10-30 21:55:22,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure d2596744999eb35a27ef7cc00864b0b8, server=jenkins-hbase4.apache.org,44371,1698702798019 in 221 msec 2023-10-30 21:55:22,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d2596744999eb35a27ef7cc00864b0b8, ASSIGN in 379 msec 2023-10-30 21:55:22,722 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-cdf2c23894004a649c1cb969397b334f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902353 2023-10-30 21:55:22,722 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-7c9ecf62c73d4d6ebc430be45a591cd0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900568 2023-10-30 21:55:22,722 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:22,722 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-201b124f8783479da2db8c864e5f289d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:22,723 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-52cddfc03c424c3a93ff03f86f483f45, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902353 2023-10-30 21:55:22,723 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-e1134b51c65e490fa63c1dc359f7d890, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:22,723 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1 2023-10-30 21:55:22,723 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1 2023-10-30 21:55:22,724 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1463c308949ad0d3c4d75470c2b83c3f columnFamilyName family1 2023-10-30 21:55:22,725 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-8252e93ff4e24c498443225f5bae4254, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:22,726 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-18f3f89d8f024f6dae81835ea97fc9af, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:22,739 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-762be7ef425c4adb8ba0678817023f42 2023-10-30 21:55:22,751 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-e837304ac33d4fc5b45309196693b5b8 2023-10-30 21:55:22,780 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f8e5bc52bffa4be0ae28f044f6bd38a7 2023-10-30 21:55:22,782 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] throttle.PressureAwareThroughputController(145): d2596744999eb35a27ef7cc00864b0b8#family2#compaction#114 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:22,782 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): d2596744999eb35a27ef7cc00864b0b8#family1#compaction#115 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:22,789 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-fefc954e8c6f46d19febd07150946c81 2023-10-30 21:55:22,789 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(310): Store=1463c308949ad0d3c4d75470c2b83c3f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:22,789 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:22,790 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2 2023-10-30 21:55:22,790 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2 2023-10-30 21:55:22,791 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1463c308949ad0d3c4d75470c2b83c3f columnFamilyName family2 2023-10-30 21:55:22,796 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-2edc474ca60f42af92614fb99dd817a4 2023-10-30 21:55:22,800 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-5fe1d4c109d34d7e942430d46855ef2e 2023-10-30 21:55:22,804 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-b4f2d550c60a4cb387e3650dc5a4a1de 2023-10-30 21:55:22,808 DEBUG [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f679d0936c2d4255a8ab3f09ec95e73f 2023-10-30 21:55:22,809 INFO [StoreOpener-1463c308949ad0d3c4d75470c2b83c3f-1] regionserver.HStore(310): Store=1463c308949ad0d3c4d75470c2b83c3f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:22,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:22,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:22,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:55:22,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:55:22,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1463c308949ad0d3c4d75470c2b83c3f; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66454699, jitterRate=-0.009747818112373352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:55:22,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:22,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f., pid=102, masterSystemTime=1698702922649 2023-10-30 21:55:22,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-30 21:55:22,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-30 21:55:22,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:22,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:22,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:22,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 862e3599e897d4e8a6ef63901b9c259f, NAME => 'testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 21:55:22,816 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1463c308949ad0d3c4d75470c2b83c3f, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:22,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:22,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:22,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:22,816 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702922816"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702922816"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702922816"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702922816"}]},"ts":"1698702922816"} 2023-10-30 21:55:22,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:22,818 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:22,819 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1 2023-10-30 21:55:22,819 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1 2023-10-30 21:55:22,819 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 862e3599e897d4e8a6ef63901b9c259f columnFamilyName family1 2023-10-30 21:55:22,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-30 21:55:22,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 1463c308949ad0d3c4d75470c2b83c3f, server=jenkins-hbase4.apache.org,44371,1698702798019 in 321 msec 2023-10-30 21:55:22,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1463c308949ad0d3c4d75470c2b83c3f, ASSIGN in 479 msec 2023-10-30 21:55:22,826 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-25e0c222295c4c5fa537b84ca586eec3 2023-10-30 21:55:22,832 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-96342fde35e0477998e2cb74ead5c496 2023-10-30 21:55:22,842 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c7e80cbb09c84e6e8d7a3d577b8ed7e1 2023-10-30 21:55:22,848 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-f3cf33cea1714d449a49b6b4083b47d2 2023-10-30 21:55:22,848 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(310): Store=862e3599e897d4e8a6ef63901b9c259f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:22,848 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:22,849 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2 2023-10-30 21:55:22,849 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2 2023-10-30 21:55:22,849 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 862e3599e897d4e8a6ef63901b9c259f columnFamilyName family2 2023-10-30 21:55:22,857 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-50b70103991a4c42badd4983f61e02e8 2023-10-30 21:55:22,863 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-a86becd250ff4d81a4e9b6cb5a2bd797 2023-10-30 21:55:22,869 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-be2278e51758412aac2c4bedd131125f 2023-10-30 21:55:22,875 DEBUG [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(539): loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c9c8735f2e534ab088dd64576c30a634 2023-10-30 21:55:22,875 INFO [StoreOpener-862e3599e897d4e8a6ef63901b9c259f-1] regionserver.HStore(310): Store=862e3599e897d4e8a6ef63901b9c259f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:22,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:22,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:22,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:55:22,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:55:22,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 862e3599e897d4e8a6ef63901b9c259f; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66267854, jitterRate=-0.012532025575637817}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:55:22,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:22,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f., pid=103, masterSystemTime=1698702922649 2023-10-30 21:55:22,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-30 21:55:22,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-30 21:55:22,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:22,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:22,883 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=862e3599e897d4e8a6ef63901b9c259f, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:22,883 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698702922882"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702922882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702922882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702922882"}]},"ts":"1698702922882"} 2023-10-30 21:55:22,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=98 2023-10-30 21:55:22,886 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 862e3599e897d4e8a6ef63901b9c259f, server=jenkins-hbase4.apache.org,44371,1698702798019 in 386 msec 2023-10-30 21:55:22,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=98, resume processing ppid=97 2023-10-30 21:55:22,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=862e3599e897d4e8a6ef63901b9c259f, ASSIGN in 545 msec 2023-10-30 21:55:22,887 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702922887"}]},"ts":"1698702922887"} 2023-10-30 21:55:22,888 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-30 21:55:22,891 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-10-30 21:55:22,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 560 msec 2023-10-30 21:55:22,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-30 21:55:22,942 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-10-30 21:55:22,960 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:22,973 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:22,982 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:22,983 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:22,991 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 21:55:23,014 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-30 21:55:23,014 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:23,015 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(139): Connect 0x71190d3d to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:55:23,021 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e68bc95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:55:23,021 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:23,021 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:23,021 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:23,145 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310306e8c1facdf0b4711b6394be31120fda3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310306e8c1facdf0b4711b6394be31120fda3 2023-10-30 21:55:23,146 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:23,148 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030bf8633c4f24f47d78b252dd6e59b5e3f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231030bf8633c4f24f47d78b252dd6e59b5e3f 2023-10-30 21:55:23,149 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:23,167 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:55:23,176 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:55:23,188 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:55:23,194 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:55:23,233 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/85c53fe020e14b56ab7d3db8ee381ed1 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-10-30 21:55:23,233 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/5f735c9b048647e49573d53149fb43ba first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-10-30 21:55:23,234 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=32 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/85c53fe020e14b56ab7d3db8ee381ed1}] 2023-10-30 21:55:23,234 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/5f735c9b048647e49573d53149fb43ba}] 2023-10-30 21:55:23,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/5f735c9b048647e49573d53149fb43ba for inclusion in 1463c308949ad0d3c4d75470c2b83c3f/family1 2023-10-30 21:55:23,243 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/85c53fe020e14b56ab7d3db8ee381ed1 for inclusion in 862e3599e897d4e8a6ef63901b9c259f/family1 2023-10-30 21:55:23,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-10-30 21:55:23,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 21:55:23,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-10-30 21:55:23,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:23,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 21:55:23,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:23,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030/family1/85c53fe020e14b56ab7d3db8ee381ed1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__5avpdu83iq0gj3hgtupu9h0tqld5rhnjnt2avjl2vjeu6mbrethcb6rghkol0qr3/family1/85c53fe020e14b56ab7d3db8ee381ed1 2023-10-30 21:55:23,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030/family1/5f735c9b048647e49573d53149fb43ba to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__dmd30c5tmaovh1r6oaa049qsl3qhair65toqr0a2kk0k0gj9igepkfsr93noq1rt/family1/5f735c9b048647e49573d53149fb43ba 2023-10-30 21:55:23,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__dmd30c5tmaovh1r6oaa049qsl3qhair65toqr0a2kk0k0gj9igepkfsr93noq1rt/family1/5f735c9b048647e49573d53149fb43ba as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/52d147f78fb74d24873d7c2559aebd15_SeqId_34_ 2023-10-30 21:55:23,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__5avpdu83iq0gj3hgtupu9h0tqld5rhnjnt2avjl2vjeu6mbrethcb6rghkol0qr3/family1/85c53fe020e14b56ab7d3db8ee381ed1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/91f4b03952ec45fab8abcb7b168a94ca_SeqId_34_ 2023-10-30 21:55:23,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__dmd30c5tmaovh1r6oaa049qsl3qhair65toqr0a2kk0k0gj9igepkfsr93noq1rt/family1/5f735c9b048647e49573d53149fb43ba into 1463c308949ad0d3c4d75470c2b83c3f/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/52d147f78fb74d24873d7c2559aebd15_SeqId_34_ - updating store file list. 2023-10-30 21:55:23,252 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__5avpdu83iq0gj3hgtupu9h0tqld5rhnjnt2avjl2vjeu6mbrethcb6rghkol0qr3/family1/85c53fe020e14b56ab7d3db8ee381ed1 into 862e3599e897d4e8a6ef63901b9c259f/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/91f4b03952ec45fab8abcb7b168a94ca_SeqId_34_ - updating store file list. 2023-10-30 21:55:23,258 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/91f4b03952ec45fab8abcb7b168a94ca_SeqId_34_ into 862e3599e897d4e8a6ef63901b9c259f/family1 2023-10-30 21:55:23,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/52d147f78fb74d24873d7c2559aebd15_SeqId_34_ into 1463c308949ad0d3c4d75470c2b83c3f/family1 2023-10-30 21:55:23,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__dmd30c5tmaovh1r6oaa049qsl3qhair65toqr0a2kk0k0gj9igepkfsr93noq1rt/family1/5f735c9b048647e49573d53149fb43ba into 1463c308949ad0d3c4d75470c2b83c3f/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/52d147f78fb74d24873d7c2559aebd15_SeqId_34_) 2023-10-30 21:55:23,259 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__5avpdu83iq0gj3hgtupu9h0tqld5rhnjnt2avjl2vjeu6mbrethcb6rghkol0qr3/family1/85c53fe020e14b56ab7d3db8ee381ed1 into 862e3599e897d4e8a6ef63901b9c259f/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/91f4b03952ec45fab8abcb7b168a94ca_SeqId_34_) 2023-10-30 21:55:23,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__dmd30c5tmaovh1r6oaa049qsl3qhair65toqr0a2kk0k0gj9igepkfsr93noq1rt/family1/5f735c9b048647e49573d53149fb43ba 2023-10-30 21:55:23,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__5avpdu83iq0gj3hgtupu9h0tqld5rhnjnt2avjl2vjeu6mbrethcb6rghkol0qr3/family1/85c53fe020e14b56ab7d3db8ee381ed1 2023-10-30 21:55:23,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:23,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-30 21:55:23,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(1912): 1463c308949ad0d3c4d75470c2b83c3f/family1 is initiating minor compaction (all files) 2023-10-30 21:55:23,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@530ed73b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-10-30 21:55:23,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:23,265 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:23,266 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:23,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-30 21:55:23,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(1912): 862e3599e897d4e8a6ef63901b9c259f/family1 is initiating minor compaction (all files) 2023-10-30 21:55:23,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1e19d30e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-10-30 21:55:23,267 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310302fc7a7801fef46499a453fa979d1bbdc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310302fc7a7801fef46499a453fa979d1bbdc 2023-10-30 21:55:23,269 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:23,269 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023103042caf970efd942908f6eaead41f58724 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023103042caf970efd942908f6eaead41f58724 2023-10-30 21:55:23,270 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:23,271 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030873d8b29f6054c89b4958fdfc689eaf2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030873d8b29f6054c89b4958fdfc689eaf2 2023-10-30 21:55:23,271 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030335dfbe58cc146a9abec0064d4917656 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030335dfbe58cc146a9abec0064d4917656 2023-10-30 21:55:23,272 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030ace5696e7871475ea5952d708abd31f1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231030ace5696e7871475ea5952d708abd31f1 2023-10-30 21:55:23,272 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 21:55:23,272 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 21:55:23,272 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030471edf7f566947818e35f240c9c822e0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030471edf7f566947818e35f240c9c822e0 2023-10-30 21:55:23,272 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:23,273 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030860f6fdcac4e4aca84932618113abfe1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030860f6fdcac4e4aca84932618113abfe1 2023-10-30 21:55:23,275 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030a89a5c2078074a9d8c4044fd11dfff1d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231030a89a5c2078074a9d8c4044fd11dfff1d 2023-10-30 21:55:23,275 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 21:55:23,275 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 21:55:23,275 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:23,953 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030bf0316ecb8ed4673b3f60d34d0edc50f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231030bf0316ecb8ed4673b3f60d34d0edc50f 2023-10-30 21:55:23,954 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:23,981 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/62e6162e23584d5faf321410ef1e9ec9 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-10-30 21:55:23,982 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/62e6162e23584d5faf321410ef1e9ec9}] 2023-10-30 21:55:23,984 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/62e6162e23584d5faf321410ef1e9ec9 for inclusion in d2596744999eb35a27ef7cc00864b0b8/family1 2023-10-30 21:55:23,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-10-30 21:55:23,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 21:55:23,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:23,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030/family1/62e6162e23584d5faf321410ef1e9ec9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__hd0vdmtaanjvqv7bvsg8qia3h498cpvvs4mumhdjukv6ll8jhhlf0d2hn50ciplu/family1/62e6162e23584d5faf321410ef1e9ec9 2023-10-30 21:55:23,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__hd0vdmtaanjvqv7bvsg8qia3h498cpvvs4mumhdjukv6ll8jhhlf0d2hn50ciplu/family1/62e6162e23584d5faf321410ef1e9ec9 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/5763203adda9456caf14e9d70fb55323_SeqId_34_ 2023-10-30 21:55:23,991 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__hd0vdmtaanjvqv7bvsg8qia3h498cpvvs4mumhdjukv6ll8jhhlf0d2hn50ciplu/family1/62e6162e23584d5faf321410ef1e9ec9 into d2596744999eb35a27ef7cc00864b0b8/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/5763203adda9456caf14e9d70fb55323_SeqId_34_ - updating store file list. 2023-10-30 21:55:23,994 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/5763203adda9456caf14e9d70fb55323_SeqId_34_ into d2596744999eb35a27ef7cc00864b0b8/family1 2023-10-30 21:55:23,994 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__hd0vdmtaanjvqv7bvsg8qia3h498cpvvs4mumhdjukv6ll8jhhlf0d2hn50ciplu/family1/62e6162e23584d5faf321410ef1e9ec9 into d2596744999eb35a27ef7cc00864b0b8/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/5763203adda9456caf14e9d70fb55323_SeqId_34_) 2023-10-30 21:55:23,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testCompactionWithHFileLink__hd0vdmtaanjvqv7bvsg8qia3h498cpvvs4mumhdjukv6ll8jhhlf0d2hn50ciplu/family1/62e6162e23584d5faf321410ef1e9ec9 2023-10-30 21:55:23,997 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:23,998 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:24,000 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310302f5e9e1d2d3241cf82beea7105f7f320 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310302f5e9e1d2d3241cf82beea7105f7f320 2023-10-30 21:55:24,002 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310308dfd8cad76c847969abb2ad3b553b1c6 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310308dfd8cad76c847969abb2ad3b553b1c6 2023-10-30 21:55:24,003 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310309868bd9e783b4c59889414d384e177a8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310309868bd9e783b4c59889414d384e177a8 2023-10-30 21:55:24,004 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231030d1c13ef769d84a4c859b2e1a706c0106 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231030d1c13ef769d84a4c859b2e1a706c0106 2023-10-30 21:55:24,004 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-30 21:55:24,004 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 21:55:24,005 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='testCompactionWithHFileLink' and column='family1' 2023-10-30 21:55:24,005 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-30 21:55:24,008 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:24,010 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:24,014 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family1/d373904a5de44490b25ec614a7cb258c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/d373904a5de44490b25ec614a7cb258c 2023-10-30 21:55:24,015 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:24,016 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:24,016 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/.tmp/family2/fc4a117d7d014514a5ba268eb81d621e as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/fc4a117d7d014514a5ba268eb81d621e 2023-10-30 21:55:24,021 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-30 21:55:24,022 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d2596744999eb35a27ef7cc00864b0b8/family1 of d2596744999eb35a27ef7cc00864b0b8 into d373904a5de44490b25ec614a7cb258c(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:24,022 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:24,022 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8., storeName=d2596744999eb35a27ef7cc00864b0b8/family1, priority=12, startTime=1698702922714; duration=1sec 2023-10-30 21:55:24,022 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-10-30 21:55:24,022 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1463c308949ad0d3c4d75470c2b83c3f/family1 in testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:24,022 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-fefc954e8c6f46d19febd07150946c81, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f8e5bc52bffa4be0ae28f044f6bd38a7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-762be7ef425c4adb8ba0678817023f42, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-e837304ac33d4fc5b45309196693b5b8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/52d147f78fb74d24873d7c2559aebd15_SeqId_34_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp, totalSize=28.9 K 2023-10-30 21:55:24,024 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d2596744999eb35a27ef7cc00864b0b8/family2 of d2596744999eb35a27ef7cc00864b0b8 into fc4a117d7d014514a5ba268eb81d621e(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:24,024 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:55:24,024 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8., storeName=d2596744999eb35a27ef7cc00864b0b8/family2, priority=12, startTime=1698702922714; duration=1sec 2023-10-30 21:55:24,024 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-fefc954e8c6f46d19febd07150946c81, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900569 2023-10-30 21:55:24,024 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-10-30 21:55:24,024 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 862e3599e897d4e8a6ef63901b9c259f/family1 in testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:24,024 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-25e0c222295c4c5fa537b84ca586eec3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-f3cf33cea1714d449a49b6b4083b47d2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-96342fde35e0477998e2cb74ead5c496, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c7e80cbb09c84e6e8d7a3d577b8ed7e1, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/91f4b03952ec45fab8abcb7b168a94ca_SeqId_34_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp, totalSize=28.9 K 2023-10-30 21:55:24,025 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f8e5bc52bffa4be0ae28f044f6bd38a7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902353 2023-10-30 21:55:24,025 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-25e0c222295c4c5fa537b84ca586eec3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900566 2023-10-30 21:55:24,026 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-762be7ef425c4adb8ba0678817023f42, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:24,026 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-f3cf33cea1714d449a49b6b4083b47d2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902352 2023-10-30 21:55:24,027 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:24,029 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-e837304ac33d4fc5b45309196693b5b8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:24,029 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-96342fde35e0477998e2cb74ead5c496, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:24,030 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 52d147f78fb74d24873d7c2559aebd15_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698702900569 2023-10-30 21:55:24,030 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c7e80cbb09c84e6e8d7a3d577b8ed7e1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:24,030 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:24,030 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting 91f4b03952ec45fab8abcb7b168a94ca_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698702900566 2023-10-30 21:55:24,058 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 247) - Thread LEAK? -, OpenFileDescriptor=768 (was 620) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 108) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=14706 (was 14915) 2023-10-30 21:55:24,075 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=288, OpenFileDescriptor=768, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=167, AvailableMemoryMB=14705 2023-10-30 21:55:24,082 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] throttle.PressureAwareThroughputController(145): 862e3599e897d4e8a6ef63901b9c259f#family1#compaction#117 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:24,082 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1463c308949ad0d3c4d75470c2b83c3f#family1#compaction#116 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:24,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-10-30 21:55:24,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-10-30 21:55:24,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-30 21:55:24,098 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-30 21:55:24,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 10 msec 2023-10-30 21:55:24,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-7c9ecf62c73d4d6ebc430be45a591cd0, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-52cddfc03c424c3a93ff03f86f483f45, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-8252e93ff4e24c498443225f5bae4254, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-18f3f89d8f024f6dae81835ea97fc9af] to archive 2023-10-30 21:55:24,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:24,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-7c9ecf62c73d4d6ebc430be45a591cd0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-7c9ecf62c73d4d6ebc430be45a591cd0 2023-10-30 21:55:24,112 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-52cddfc03c424c3a93ff03f86f483f45 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-52cddfc03c424c3a93ff03f86f483f45 2023-10-30 21:55:24,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-8252e93ff4e24c498443225f5bae4254 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-8252e93ff4e24c498443225f5bae4254 2023-10-30 21:55:24,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-18f3f89d8f024f6dae81835ea97fc9af to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family1/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-18f3f89d8f024f6dae81835ea97fc9af 2023-10-30 21:55:24,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-3d9e6ecd66544295839c15e223644f4a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-cdf2c23894004a649c1cb969397b334f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-201b124f8783479da2db8c864e5f289d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-e1134b51c65e490fa63c1dc359f7d890] to archive 2023-10-30 21:55:24,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:24,119 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-3d9e6ecd66544295839c15e223644f4a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-3d9e6ecd66544295839c15e223644f4a 2023-10-30 21:55:24,120 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-cdf2c23894004a649c1cb969397b334f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-cdf2c23894004a649c1cb969397b334f 2023-10-30 21:55:24,122 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-201b124f8783479da2db8c864e5f289d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-201b124f8783479da2db8c864e5f289d 2023-10-30 21:55:24,123 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-e1134b51c65e490fa63c1dc359f7d890 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/family2/testCompactionWithHFileLink=d2596744999eb35a27ef7cc00864b0b8-e1134b51c65e490fa63c1dc359f7d890 2023-10-30 21:55:24,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-30 21:55:24,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 21:55:24,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-10-30 21:55:24,201 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:55:24,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-10-30 21:55:24,201 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:55:24,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 21:55:24,203 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:55:24,203 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:55:24,203 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f 2023-10-30 21:55:24,204 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef empty. 2023-10-30 21:55:24,204 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f empty. 2023-10-30 21:55:24,204 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078 empty. 2023-10-30 21:55:24,204 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:55:24,204 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f 2023-10-30 21:55:24,204 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:55:24,204 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-10-30 21:55:24,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 21:55:24,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 21:55:24,611 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-10-30 21:55:24,613 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 80f2ea819d0876ea7ac6b96623c135ef, NAME => 'ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:55:24,613 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 89ebfe6836789cb4975f6008a3b09078, NAME => 'ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:55:24,613 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => f370aafa6070d611274135fa479ee59f, NAME => 'ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:55:24,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 21:55:24,915 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family1/0617bb483bb945cf98408ed7b0630e0c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/0617bb483bb945cf98408ed7b0630e0c 2023-10-30 21:55:24,919 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 1463c308949ad0d3c4d75470c2b83c3f/family1 of 1463c308949ad0d3c4d75470c2b83c3f into 0617bb483bb945cf98408ed7b0630e0c(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:55:24,919 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:24,919 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698702923263; duration=0sec 2023-10-30 21:55:24,919 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-30 21:55:24,919 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 21:55:24,921 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 21:55:24,921 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1912): 1463c308949ad0d3c4d75470c2b83c3f/family2 is initiating minor compaction (all files) 2023-10-30 21:55:24,921 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1463c308949ad0d3c4d75470c2b83c3f/family2 in testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:55:24,921 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-b4f2d550c60a4cb387e3650dc5a4a1de, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-2edc474ca60f42af92614fb99dd817a4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-5fe1d4c109d34d7e942430d46855ef2e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f679d0936c2d4255a8ab3f09ec95e73f] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp, totalSize=20.4 K 2023-10-30 21:55:24,922 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-b4f2d550c60a4cb387e3650dc5a4a1de, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900569 2023-10-30 21:55:24,922 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-2edc474ca60f42af92614fb99dd817a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902353 2023-10-30 21:55:24,922 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-5fe1d4c109d34d7e942430d46855ef2e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:24,923 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f679d0936c2d4255a8ab3f09ec95e73f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:24,930 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:55:24,934 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1463c308949ad0d3c4d75470c2b83c3f#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:25,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-fefc954e8c6f46d19febd07150946c81, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f8e5bc52bffa4be0ae28f044f6bd38a7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-762be7ef425c4adb8ba0678817023f42, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-e837304ac33d4fc5b45309196693b5b8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/52d147f78fb74d24873d7c2559aebd15_SeqId_34_] to archive 2023-10-30 21:55:25,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:25,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-fefc954e8c6f46d19febd07150946c81 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-fefc954e8c6f46d19febd07150946c81 2023-10-30 21:55:25,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f8e5bc52bffa4be0ae28f044f6bd38a7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f8e5bc52bffa4be0ae28f044f6bd38a7 2023-10-30 21:55:25,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-762be7ef425c4adb8ba0678817023f42 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-762be7ef425c4adb8ba0678817023f42 2023-10-30 21:55:25,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-e837304ac33d4fc5b45309196693b5b8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-e837304ac33d4fc5b45309196693b5b8 2023-10-30 21:55:25,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/52d147f78fb74d24873d7c2559aebd15_SeqId_34_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family1/52d147f78fb74d24873d7c2559aebd15_SeqId_34_ 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing f370aafa6070d611274135fa479ee59f, disabling compactions & flushes 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 89ebfe6836789cb4975f6008a3b09078, disabling compactions & flushes 2023-10-30 21:55:25,023 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:25,023 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 80f2ea819d0876ea7ac6b96623c135ef, disabling compactions & flushes 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. after waiting 0 ms 2023-10-30 21:55:25,023 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. after waiting 0 ms 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. after waiting 0 ms 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:25,024 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:25,023 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:25,024 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:55:25,024 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:25,024 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:25,024 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:55:25,024 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:55:25,026 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:55:25,028 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698702925028"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702925028"}]},"ts":"1698702925028"} 2023-10-30 21:55:25,028 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698702925028"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702925028"}]},"ts":"1698702925028"} 2023-10-30 21:55:25,028 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698702925028"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702925028"}]},"ts":"1698702925028"} 2023-10-30 21:55:25,030 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 21:55:25,031 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:55:25,031 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702925031"}]},"ts":"1698702925031"} 2023-10-30 21:55:25,032 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-10-30 21:55:25,037 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80f2ea819d0876ea7ac6b96623c135ef, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=89ebfe6836789cb4975f6008a3b09078, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f370aafa6070d611274135fa479ee59f, ASSIGN}] 2023-10-30 21:55:25,038 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80f2ea819d0876ea7ac6b96623c135ef, ASSIGN 2023-10-30 21:55:25,038 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=89ebfe6836789cb4975f6008a3b09078, ASSIGN 2023-10-30 21:55:25,039 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f370aafa6070d611274135fa479ee59f, ASSIGN 2023-10-30 21:55:25,039 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80f2ea819d0876ea7ac6b96623c135ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:55:25,039 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=89ebfe6836789cb4975f6008a3b09078, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:55:25,039 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f370aafa6070d611274135fa479ee59f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:55:25,192 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=f370aafa6070d611274135fa479ee59f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:25,192 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=80f2ea819d0876ea7ac6b96623c135ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:25,192 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=89ebfe6836789cb4975f6008a3b09078, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:25,193 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698702925192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702925192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702925192"}]},"ts":"1698702925192"} 2023-10-30 21:55:25,193 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698702925192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702925192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702925192"}]},"ts":"1698702925192"} 2023-10-30 21:55:25,193 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698702925192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702925192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702925192"}]},"ts":"1698702925192"} 2023-10-30 21:55:25,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure f370aafa6070d611274135fa479ee59f, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:25,195 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 80f2ea819d0876ea7ac6b96623c135ef, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:25,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 89ebfe6836789cb4975f6008a3b09078, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:25,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 21:55:25,307 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family1/13ede6a0d4b24b759de48dff0ffc8a9e as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/13ede6a0d4b24b759de48dff0ffc8a9e 2023-10-30 21:55:25,311 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 862e3599e897d4e8a6ef63901b9c259f/family1 of 862e3599e897d4e8a6ef63901b9c259f into 13ede6a0d4b24b759de48dff0ffc8a9e(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:25,311 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:25,311 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698702923266; duration=1sec 2023-10-30 21:55:25,311 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-30 21:55:25,311 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 21:55:25,313 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 21:55:25,313 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HStore(1912): 862e3599e897d4e8a6ef63901b9c259f/family2 is initiating minor compaction (all files) 2023-10-30 21:55:25,313 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 862e3599e897d4e8a6ef63901b9c259f/family2 in testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:55:25,313 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-a86becd250ff4d81a4e9b6cb5a2bd797, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-be2278e51758412aac2c4bedd131125f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c9c8735f2e534ab088dd64576c30a634, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-50b70103991a4c42badd4983f61e02e8] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp, totalSize=20.4 K 2023-10-30 21:55:25,314 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-a86becd250ff4d81a4e9b6cb5a2bd797, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702900566 2023-10-30 21:55:25,314 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-be2278e51758412aac2c4bedd131125f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702902352 2023-10-30 21:55:25,314 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c9c8735f2e534ab088dd64576c30a634, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702904148 2023-10-30 21:55:25,315 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-50b70103991a4c42badd4983f61e02e8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702905950 2023-10-30 21:55:25,326 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] throttle.PressureAwareThroughputController(145): 862e3599e897d4e8a6ef63901b9c259f#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:25,346 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:25,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:25,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80f2ea819d0876ea7ac6b96623c135ef, NAME => 'ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 21:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:55:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:55:25,350 INFO [StoreOpener-80f2ea819d0876ea7ac6b96623c135ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:55:25,351 DEBUG [StoreOpener-80f2ea819d0876ea7ac6b96623c135ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1 2023-10-30 21:55:25,351 DEBUG [StoreOpener-80f2ea819d0876ea7ac6b96623c135ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1 2023-10-30 21:55:25,351 INFO [StoreOpener-80f2ea819d0876ea7ac6b96623c135ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80f2ea819d0876ea7ac6b96623c135ef columnFamilyName family1 2023-10-30 21:55:25,352 INFO [StoreOpener-80f2ea819d0876ea7ac6b96623c135ef-1] regionserver.HStore(310): Store=80f2ea819d0876ea7ac6b96623c135ef/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:25,352 INFO [StoreOpener-80f2ea819d0876ea7ac6b96623c135ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:55:25,353 DEBUG [StoreOpener-80f2ea819d0876ea7ac6b96623c135ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2 2023-10-30 21:55:25,353 DEBUG [StoreOpener-80f2ea819d0876ea7ac6b96623c135ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2 2023-10-30 21:55:25,354 INFO [StoreOpener-80f2ea819d0876ea7ac6b96623c135ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80f2ea819d0876ea7ac6b96623c135ef columnFamilyName family2 2023-10-30 21:55:25,355 INFO [StoreOpener-80f2ea819d0876ea7ac6b96623c135ef-1] regionserver.HStore(310): Store=80f2ea819d0876ea7ac6b96623c135ef/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:25,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:55:25,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:55:25,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:55:25,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:55:25,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:55:25,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80f2ea819d0876ea7ac6b96623c135ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68396226, jitterRate=0.019183188676834106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:55:25,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:55:25,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef., pid=110, masterSystemTime=1698702925346 2023-10-30 21:55:25,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:25,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:25,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:25,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 89ebfe6836789cb4975f6008a3b09078, NAME => 'ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 21:55:25,362 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=80f2ea819d0876ea7ac6b96623c135ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:25,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:55:25,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:25,362 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698702925362"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702925362"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702925362"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702925362"}]},"ts":"1698702925362"} 2023-10-30 21:55:25,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:55:25,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:55:25,363 INFO [StoreOpener-89ebfe6836789cb4975f6008a3b09078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:55:25,364 DEBUG [StoreOpener-89ebfe6836789cb4975f6008a3b09078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1 2023-10-30 21:55:25,364 DEBUG [StoreOpener-89ebfe6836789cb4975f6008a3b09078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1 2023-10-30 21:55:25,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=106 2023-10-30 21:55:25,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 80f2ea819d0876ea7ac6b96623c135ef, server=jenkins-hbase4.apache.org,44371,1698702798019 in 168 msec 2023-10-30 21:55:25,364 INFO [StoreOpener-89ebfe6836789cb4975f6008a3b09078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89ebfe6836789cb4975f6008a3b09078 columnFamilyName family1 2023-10-30 21:55:25,365 INFO [StoreOpener-89ebfe6836789cb4975f6008a3b09078-1] regionserver.HStore(310): Store=89ebfe6836789cb4975f6008a3b09078/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:25,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=80f2ea819d0876ea7ac6b96623c135ef, ASSIGN in 327 msec 2023-10-30 21:55:25,365 INFO [StoreOpener-89ebfe6836789cb4975f6008a3b09078-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:55:25,366 DEBUG [StoreOpener-89ebfe6836789cb4975f6008a3b09078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2 2023-10-30 21:55:25,366 DEBUG [StoreOpener-89ebfe6836789cb4975f6008a3b09078-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2 2023-10-30 21:55:25,367 INFO [StoreOpener-89ebfe6836789cb4975f6008a3b09078-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89ebfe6836789cb4975f6008a3b09078 columnFamilyName family2 2023-10-30 21:55:25,367 INFO [StoreOpener-89ebfe6836789cb4975f6008a3b09078-1] regionserver.HStore(310): Store=89ebfe6836789cb4975f6008a3b09078/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:25,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:55:25,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:55:25,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:55:25,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:55:25,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:55:25,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 89ebfe6836789cb4975f6008a3b09078; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61932634, jitterRate=-0.07713183760643005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:55:25,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:55:25,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078., pid=111, masterSystemTime=1698702925346 2023-10-30 21:55:25,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:25,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:25,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:25,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f370aafa6070d611274135fa479ee59f, NAME => 'ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 21:55:25,375 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=89ebfe6836789cb4975f6008a3b09078, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:25,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction f370aafa6070d611274135fa479ee59f 2023-10-30 21:55:25,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:25,375 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698702925375"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702925375"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702925375"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702925375"}]},"ts":"1698702925375"} 2023-10-30 21:55:25,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f370aafa6070d611274135fa479ee59f 2023-10-30 21:55:25,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f370aafa6070d611274135fa479ee59f 2023-10-30 21:55:25,376 INFO [StoreOpener-f370aafa6070d611274135fa479ee59f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f370aafa6070d611274135fa479ee59f 2023-10-30 21:55:25,377 DEBUG [StoreOpener-f370aafa6070d611274135fa479ee59f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1 2023-10-30 21:55:25,377 DEBUG [StoreOpener-f370aafa6070d611274135fa479ee59f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1 2023-10-30 21:55:25,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=107 2023-10-30 21:55:25,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 89ebfe6836789cb4975f6008a3b09078, server=jenkins-hbase4.apache.org,44371,1698702798019 in 180 msec 2023-10-30 21:55:25,378 INFO [StoreOpener-f370aafa6070d611274135fa479ee59f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f370aafa6070d611274135fa479ee59f columnFamilyName family1 2023-10-30 21:55:25,378 INFO [StoreOpener-f370aafa6070d611274135fa479ee59f-1] regionserver.HStore(310): Store=f370aafa6070d611274135fa479ee59f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:25,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=89ebfe6836789cb4975f6008a3b09078, ASSIGN in 341 msec 2023-10-30 21:55:25,379 INFO [StoreOpener-f370aafa6070d611274135fa479ee59f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f370aafa6070d611274135fa479ee59f 2023-10-30 21:55:25,379 DEBUG [StoreOpener-f370aafa6070d611274135fa479ee59f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2 2023-10-30 21:55:25,379 DEBUG [StoreOpener-f370aafa6070d611274135fa479ee59f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2 2023-10-30 21:55:25,380 INFO [StoreOpener-f370aafa6070d611274135fa479ee59f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f370aafa6070d611274135fa479ee59f columnFamilyName family2 2023-10-30 21:55:25,380 INFO [StoreOpener-f370aafa6070d611274135fa479ee59f-1] regionserver.HStore(310): Store=f370aafa6070d611274135fa479ee59f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:25,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f 2023-10-30 21:55:25,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f 2023-10-30 21:55:25,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:55:25,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f370aafa6070d611274135fa479ee59f 2023-10-30 21:55:25,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:55:25,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f370aafa6070d611274135fa479ee59f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60227640, jitterRate=-0.10253822803497314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:55:25,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:55:25,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f., pid=109, masterSystemTime=1698702925346 2023-10-30 21:55:25,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:25,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:25,387 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=f370aafa6070d611274135fa479ee59f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:25,387 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698702925386"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702925386"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702925386"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702925386"}]},"ts":"1698702925386"} 2023-10-30 21:55:25,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=108 2023-10-30 21:55:25,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure f370aafa6070d611274135fa479ee59f, server=jenkins-hbase4.apache.org,44371,1698702798019 in 194 msec 2023-10-30 21:55:25,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=105 2023-10-30 21:55:25,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f370aafa6070d611274135fa479ee59f, ASSIGN in 351 msec 2023-10-30 21:55:25,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:55:25,390 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702925390"}]},"ts":"1698702925390"} 2023-10-30 21:55:25,391 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-10-30 21:55:25,393 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:55:25,394 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1940 sec 2023-10-30 21:55:25,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-25e0c222295c4c5fa537b84ca586eec3, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-f3cf33cea1714d449a49b6b4083b47d2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-96342fde35e0477998e2cb74ead5c496, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c7e80cbb09c84e6e8d7a3d577b8ed7e1, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/91f4b03952ec45fab8abcb7b168a94ca_SeqId_34_] to archive 2023-10-30 21:55:25,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:25,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-25e0c222295c4c5fa537b84ca586eec3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-25e0c222295c4c5fa537b84ca586eec3 2023-10-30 21:55:25,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-f3cf33cea1714d449a49b6b4083b47d2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-f3cf33cea1714d449a49b6b4083b47d2 2023-10-30 21:55:25,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-96342fde35e0477998e2cb74ead5c496 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-96342fde35e0477998e2cb74ead5c496 2023-10-30 21:55:25,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c7e80cbb09c84e6e8d7a3d577b8ed7e1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c7e80cbb09c84e6e8d7a3d577b8ed7e1 2023-10-30 21:55:25,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/91f4b03952ec45fab8abcb7b168a94ca_SeqId_34_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family1/91f4b03952ec45fab8abcb7b168a94ca_SeqId_34_ 2023-10-30 21:55:26,150 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/.tmp/family2/9f7d6025bbaf46e88a4125ff3456241a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/9f7d6025bbaf46e88a4125ff3456241a 2023-10-30 21:55:26,154 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 1463c308949ad0d3c4d75470c2b83c3f/family2 of 1463c308949ad0d3c4d75470c2b83c3f into 9f7d6025bbaf46e88a4125ff3456241a(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:26,154 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:55:26,154 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f., storeName=1463c308949ad0d3c4d75470c2b83c3f/family2, priority=12, startTime=1698702922815; duration=1sec 2023-10-30 21:55:26,155 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-30 21:55:26,155 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-10-30 21:55:26,155 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-30 21:55:26,155 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-30 21:55:26,155 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. because compaction request was cancelled 2023-10-30 21:55:26,155 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-10-30 21:55:26,155 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-30 21:55:26,155 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-30 21:55:26,155 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. because compaction request was cancelled 2023-10-30 21:55:26,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-b4f2d550c60a4cb387e3650dc5a4a1de, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-2edc474ca60f42af92614fb99dd817a4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-5fe1d4c109d34d7e942430d46855ef2e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f679d0936c2d4255a8ab3f09ec95e73f] to archive 2023-10-30 21:55:26,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:26,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-b4f2d550c60a4cb387e3650dc5a4a1de to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-b4f2d550c60a4cb387e3650dc5a4a1de 2023-10-30 21:55:26,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-2edc474ca60f42af92614fb99dd817a4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-2edc474ca60f42af92614fb99dd817a4 2023-10-30 21:55:26,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-5fe1d4c109d34d7e942430d46855ef2e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-5fe1d4c109d34d7e942430d46855ef2e 2023-10-30 21:55:26,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f679d0936c2d4255a8ab3f09ec95e73f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/family2/testCompactionWithHFileLink=1463c308949ad0d3c4d75470c2b83c3f-f679d0936c2d4255a8ab3f09ec95e73f 2023-10-30 21:55:26,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-30 21:55:26,306 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-10-30 21:55:26,311 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:26,312 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:26,312 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:26,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:26,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 21:55:26,315 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 21:55:26,315 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:26,315 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 21:55:26,315 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 21:55:26,316 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:26,316 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:26,317 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:26,317 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:26,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:26,317 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:26,317 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:26,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:26,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 21:55:26,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 21:55:26,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 21:55:26,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:26,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 21:55:26,318 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:26,318 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:26,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:26,318 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:26,319 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. started... 2023-10-30 21:55:26,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:26,318 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. started... 2023-10-30 21:55:26,318 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. started... 2023-10-30 21:55:26,320 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f370aafa6070d611274135fa479ee59f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 21:55:26,320 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 80f2ea819d0876ea7ac6b96623c135ef 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 21:55:26,320 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 89ebfe6836789cb4975f6008a3b09078 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 21:55:26,544 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/.tmp/family2/2f94350f3432417fa7b48c99a12e2d0c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/2f94350f3432417fa7b48c99a12e2d0c 2023-10-30 21:55:26,548 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 862e3599e897d4e8a6ef63901b9c259f/family2 of 862e3599e897d4e8a6ef63901b9c259f into 2f94350f3432417fa7b48c99a12e2d0c(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:26,548 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:55:26,548 INFO [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f., storeName=862e3599e897d4e8a6ef63901b9c259f/family2, priority=12, startTime=1698702922881; duration=1sec 2023-10-30 21:55:26,548 DEBUG [RS:0;jenkins-hbase4:44371-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:55:26,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-a86becd250ff4d81a4e9b6cb5a2bd797, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-be2278e51758412aac2c4bedd131125f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c9c8735f2e534ab088dd64576c30a634, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-50b70103991a4c42badd4983f61e02e8] to archive 2023-10-30 21:55:26,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:26,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-a86becd250ff4d81a4e9b6cb5a2bd797 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-a86becd250ff4d81a4e9b6cb5a2bd797 2023-10-30 21:55:26,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-be2278e51758412aac2c4bedd131125f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-be2278e51758412aac2c4bedd131125f 2023-10-30 21:55:26,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c9c8735f2e534ab088dd64576c30a634 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-c9c8735f2e534ab088dd64576c30a634 2023-10-30 21:55:26,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-50b70103991a4c42badd4983f61e02e8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/family2/testCompactionWithHFileLink=862e3599e897d4e8a6ef63901b9c259f-50b70103991a4c42badd4983f61e02e8 2023-10-30 21:55:26,733 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310306f42095679364b53a77a193b0ce858d5 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310306f42095679364b53a77a193b0ce858d5 2023-10-30 21:55:26,733 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103018a4e3d1759b41b8b1fba64197ffe24d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023103018a4e3d1759b41b8b1fba64197ffe24d 2023-10-30 21:55:26,733 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310304e69966a74c94cc1b6e6c3dd8adb1fc6 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310304e69966a74c94cc1b6e6c3dd8adb1fc6 2023-10-30 21:55:27,139 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/9120026bd9ad4da98bc4591dd209960d 2023-10-30 21:55:27,139 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/ffe0c402f7d44e36a49c3e7980f5c6fa 2023-10-30 21:55:27,139 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/d273a58379cc43369e4c7b8ee26ff7af 2023-10-30 21:55:27,183 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103043c0f775152743bda47f686f371b0a47 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023103043c0f775152743bda47f686f371b0a47 2023-10-30 21:55:27,192 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/7ac3962423b84e09b5eb588f965e4396 2023-10-30 21:55:27,196 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103099ceb352cce04f078a2d7fb203f2e45d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023103099ceb352cce04f078a2d7fb203f2e45d 2023-10-30 21:55:27,197 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/9120026bd9ad4da98bc4591dd209960d as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/9120026bd9ad4da98bc4591dd209960d 2023-10-30 21:55:27,215 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/9120026bd9ad4da98bc4591dd209960d, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 21:55:27,216 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/7ac3962423b84e09b5eb588f965e4396 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/7ac3962423b84e09b5eb588f965e4396 2023-10-30 21:55:27,216 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/8e1dfa7dfeea40249dbccd271dcf0b7f 2023-10-30 21:55:27,221 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/7ac3962423b84e09b5eb588f965e4396, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 21:55:27,221 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/d273a58379cc43369e4c7b8ee26ff7af as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d273a58379cc43369e4c7b8ee26ff7af 2023-10-30 21:55:27,222 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 89ebfe6836789cb4975f6008a3b09078 in 902ms, sequenceid=5, compaction requested=false 2023-10-30 21:55:27,222 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-10-30 21:55:27,223 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:55:27,223 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:27,223 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:27,228 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d273a58379cc43369e4c7b8ee26ff7af, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 21:55:27,229 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/8e1dfa7dfeea40249dbccd271dcf0b7f as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8e1dfa7dfeea40249dbccd271dcf0b7f 2023-10-30 21:55:27,233 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8e1dfa7dfeea40249dbccd271dcf0b7f, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 21:55:27,234 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 80f2ea819d0876ea7ac6b96623c135ef in 914ms, sequenceid=5, compaction requested=false 2023-10-30 21:55:27,235 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:55:27,235 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:27,235 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:27,579 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030237e3b694dfe4945a3f218c7fca31bcb to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231030237e3b694dfe4945a3f218c7fca31bcb 2023-10-30 21:55:27,985 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/cdf2373399434ced8947fabe7b0b008e 2023-10-30 21:55:27,990 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/ffe0c402f7d44e36a49c3e7980f5c6fa as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/ffe0c402f7d44e36a49c3e7980f5c6fa 2023-10-30 21:55:27,995 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/ffe0c402f7d44e36a49c3e7980f5c6fa, entries=4, sequenceid=5, filesize=5.4 K 2023-10-30 21:55:27,995 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/cdf2373399434ced8947fabe7b0b008e as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/cdf2373399434ced8947fabe7b0b008e 2023-10-30 21:55:27,999 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/cdf2373399434ced8947fabe7b0b008e, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 21:55:28,000 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f370aafa6070d611274135fa479ee59f in 1680ms, sequenceid=5, compaction requested=false 2023-10-30 21:55:28,000 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:55:28,000 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:28,000 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:28,001 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:28,001 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,001 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 21:55:28,001 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 21:55:28,004 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:28,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:28,004 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:28,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:28,004 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:28,004 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:28,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:28,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:28,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:28,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 21:55:28,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d96b7c0[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:28,006 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 21:55:28,006 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:28,007 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:28,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:28,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:28,008 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 21:55:28,008 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 21:55:28,008 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:28,008 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,008 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:28,009 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 21:55:28,009 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,009 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:28,010 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 21:55:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:28,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:28,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:28,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 21:55:28,013 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 21:55:28,013 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:28,013 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:28,013 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 21:55:28,013 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:28,015 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:28,015 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:28,015 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:28,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:28,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:28,016 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:28,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:28,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:28,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:28,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:28,017 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:28,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:28,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:28,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:28,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:28,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:28,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:28,021 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:28,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:28,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:28,021 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:28,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 21:55:28,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 21:55:28,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:28,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:28,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:28,022 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:28,022 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:28,122 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:28,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:28,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:28,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:28,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:28,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:28,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:28,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 21:55:28,129 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 21:55:28,129 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:28,129 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 21:55:28,129 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 21:55:28,130 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:28,130 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:28,131 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,131 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:28,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:28,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:28,131 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:28,131 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:28,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:28,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:28,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:28,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:28,132 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 21:55:28,133 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 21:55:28,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 21:55:28,133 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 21:55:28,133 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:28,133 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 21:55:28,133 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:28,133 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. started... 2023-10-30 21:55:28,133 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:28,133 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. started... 2023-10-30 21:55:28,133 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 89ebfe6836789cb4975f6008a3b09078 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 21:55:28,133 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 80f2ea819d0876ea7ac6b96623c135ef 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 21:55:28,133 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:28,134 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:28,141 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:28,141 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. started... 2023-10-30 21:55:28,141 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f370aafa6070d611274135fa479ee59f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 21:55:28,166 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310308b1bd4f1d03340f3969a22213c5177f7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310308b1bd4f1d03340f3969a22213c5177f7 2023-10-30 21:55:28,170 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030bebc3b92ff1341079c69253f7c7ed002 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030bebc3b92ff1341079c69253f7c7ed002 2023-10-30 21:55:28,559 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103028520a388d4442e9b30e9b8ea9e90df4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023103028520a388d4442e9b30e9b8ea9e90df4 2023-10-30 21:55:28,574 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/5c3717d088e24eaa95b1be883e8441c7 2023-10-30 21:55:28,579 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/bd59ce5921984ecf9406b362cfea871c 2023-10-30 21:55:28,965 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/3b3d2cf2d48e4532b43bd97fc8eb6580 2023-10-30 21:55:28,993 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030ed573e6774254dfc90598305ef0f8c61 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231030ed573e6774254dfc90598305ef0f8c61 2023-10-30 21:55:28,996 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310303868d1094e6843ba8deb72a589fb58c9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310303868d1094e6843ba8deb72a589fb58c9 2023-10-30 21:55:29,381 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030adcd395ec0014119a17d38f7ab74a4fe to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231030adcd395ec0014119a17d38f7ab74a4fe 2023-10-30 21:55:29,409 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/333de0c228c14e7bb28ad26d3adf10ed 2023-10-30 21:55:29,409 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/0255d39dc30f46a19e09426d52b4a614 2023-10-30 21:55:29,414 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/5c3717d088e24eaa95b1be883e8441c7 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/5c3717d088e24eaa95b1be883e8441c7 2023-10-30 21:55:29,415 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/bd59ce5921984ecf9406b362cfea871c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/bd59ce5921984ecf9406b362cfea871c 2023-10-30 21:55:29,419 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/5c3717d088e24eaa95b1be883e8441c7, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 21:55:29,419 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/bd59ce5921984ecf9406b362cfea871c, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 21:55:29,419 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/333de0c228c14e7bb28ad26d3adf10ed as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/333de0c228c14e7bb28ad26d3adf10ed 2023-10-30 21:55:29,420 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/0255d39dc30f46a19e09426d52b4a614 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/0255d39dc30f46a19e09426d52b4a614 2023-10-30 21:55:29,424 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/333de0c228c14e7bb28ad26d3adf10ed, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 21:55:29,425 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 89ebfe6836789cb4975f6008a3b09078 in 1292ms, sequenceid=9, compaction requested=false 2023-10-30 21:55:29,425 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/0255d39dc30f46a19e09426d52b4a614, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 21:55:29,425 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:55:29,425 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:29,425 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:29,427 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f370aafa6070d611274135fa479ee59f in 1286ms, sequenceid=9, compaction requested=false 2023-10-30 21:55:29,427 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:55:29,427 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:29,427 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:29,786 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/8c714a74d98c4b1785c53f3eaa078c00 2023-10-30 21:55:29,791 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/3b3d2cf2d48e4532b43bd97fc8eb6580 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/3b3d2cf2d48e4532b43bd97fc8eb6580 2023-10-30 21:55:29,796 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/3b3d2cf2d48e4532b43bd97fc8eb6580, entries=4, sequenceid=9, filesize=5.4 K 2023-10-30 21:55:29,797 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/8c714a74d98c4b1785c53f3eaa078c00 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8c714a74d98c4b1785c53f3eaa078c00 2023-10-30 21:55:29,801 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8c714a74d98c4b1785c53f3eaa078c00, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 21:55:29,801 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 80f2ea819d0876ea7ac6b96623c135ef in 1668ms, sequenceid=9, compaction requested=false 2023-10-30 21:55:29,802 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:55:29,802 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 21:55:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 21:55:29,805 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:29,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:29,805 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:29,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:29,805 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:29,805 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:29,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:29,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:29,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:29,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 21:55:29,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38fa3ab9[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:29,807 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 21:55:29,807 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:29,808 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:29,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:29,808 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 21:55:29,808 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 21:55:29,808 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:29,809 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,809 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:29,814 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,814 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 21:55:29,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:29,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:29,814 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:29,814 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 21:55:29,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:29,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:29,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:29,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:29,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 21:55:29,817 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 21:55:29,817 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:29,817 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:29,818 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 21:55:29,818 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:29,819 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:29,819 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:29,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:29,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:29,821 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:29,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:29,822 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:29,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:29,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:29,823 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:29,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,827 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:29,827 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:29,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 21:55:29,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:29,827 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:29,827 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:29,827 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:29,827 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:29,827 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:29,827 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:29,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:29,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:29,827 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,828 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:29,828 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:29,828 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:29,927 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:29,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:29,930 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:29,930 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:29,930 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:29,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:29,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:29,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 21:55:29,934 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 21:55:29,935 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:29,935 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 21:55:29,935 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 21:55:29,935 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:29,935 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:29,937 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:29,937 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:29,937 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:29,937 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:29,938 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:29,938 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 21:55:29,938 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 21:55:29,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 21:55:29,939 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 21:55:29,939 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:29,939 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 21:55:29,939 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:29,939 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. started... 2023-10-30 21:55:29,939 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:29,939 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. started... 2023-10-30 21:55:29,939 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 89ebfe6836789cb4975f6008a3b09078 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 21:55:29,939 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 80f2ea819d0876ea7ac6b96623c135ef 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 21:55:29,940 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:29,940 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:29,940 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:29,940 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. started... 2023-10-30 21:55:29,940 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f370aafa6070d611274135fa479ee59f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 21:55:29,970 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030802141dd40f9412da68878b9e2f75391 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030802141dd40f9412da68878b9e2f75391 2023-10-30 21:55:29,979 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/04e5ab429da14eefa2edd30afdbab53a 2023-10-30 21:55:29,995 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103049a2ae2061b948ff85a0fce25ce38a87 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023103049a2ae2061b948ff85a0fce25ce38a87 2023-10-30 21:55:30,367 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030b8e2a542976640acbb7d48770b08164c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030b8e2a542976640acbb7d48770b08164c 2023-10-30 21:55:30,368 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310301f84e69cdc4b4acdb6c057189d85d0d4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310301f84e69cdc4b4acdb6c057189d85d0d4 2023-10-30 21:55:30,402 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/2bb0f451315c47f2888492867a5ee490 2023-10-30 21:55:30,406 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/04e5ab429da14eefa2edd30afdbab53a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/04e5ab429da14eefa2edd30afdbab53a 2023-10-30 21:55:30,410 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/04e5ab429da14eefa2edd30afdbab53a, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 21:55:30,410 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/2bb0f451315c47f2888492867a5ee490 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/2bb0f451315c47f2888492867a5ee490 2023-10-30 21:55:30,413 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/2bb0f451315c47f2888492867a5ee490, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 21:55:30,414 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 89ebfe6836789cb4975f6008a3b09078 in 475ms, sequenceid=13, compaction requested=true 2023-10-30 21:55:30,414 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:55:30,414 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:30,414 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:30,772 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/85b42bff21db47a0bd58fb7a82ea3686 2023-10-30 21:55:30,772 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/578e5f57a19d4f04b26132d5768a9831 2023-10-30 21:55:30,786 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103003f628b985f74c0c9ce34a0e8bf03de1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023103003f628b985f74c0c9ce34a0e8bf03de1 2023-10-30 21:55:30,786 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030e05afa41526c44f8ac83d511783e04c9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231030e05afa41526c44f8ac83d511783e04c9 2023-10-30 21:55:30,791 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/8cd883e5a07949599db157904b247a20 2023-10-30 21:55:30,795 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/85b42bff21db47a0bd58fb7a82ea3686 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/85b42bff21db47a0bd58fb7a82ea3686 2023-10-30 21:55:30,799 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/85b42bff21db47a0bd58fb7a82ea3686, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 21:55:30,800 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/8cd883e5a07949599db157904b247a20 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/8cd883e5a07949599db157904b247a20 2023-10-30 21:55:30,803 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/8cd883e5a07949599db157904b247a20, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 21:55:30,804 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f370aafa6070d611274135fa479ee59f in 864ms, sequenceid=13, compaction requested=true 2023-10-30 21:55:30,804 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:55:30,804 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:30,804 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:30,850 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:55:31,192 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/08e67e6987764bac9cd99db641aeec43 2023-10-30 21:55:31,197 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/578e5f57a19d4f04b26132d5768a9831 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/578e5f57a19d4f04b26132d5768a9831 2023-10-30 21:55:31,200 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/578e5f57a19d4f04b26132d5768a9831, entries=4, sequenceid=13, filesize=5.4 K 2023-10-30 21:55:31,201 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/08e67e6987764bac9cd99db641aeec43 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/08e67e6987764bac9cd99db641aeec43 2023-10-30 21:55:31,205 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/08e67e6987764bac9cd99db641aeec43, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 21:55:31,206 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 80f2ea819d0876ea7ac6b96623c135ef in 1267ms, sequenceid=13, compaction requested=true 2023-10-30 21:55:31,206 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:55:31,206 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 21:55:31,206 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 21:55:31,209 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:31,209 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:31,210 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:31,210 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:31,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:31,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:31,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:31,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:31,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 21:55:31,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@204c63e[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:31,211 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 21:55:31,211 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:31,217 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:31,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:31,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:31,217 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 21:55:31,217 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 21:55:31,217 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:31,218 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,218 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:31,219 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,219 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 21:55:31,219 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:31,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:31,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:31,219 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 21:55:31,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:31,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:31,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:31,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:31,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:31,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:31,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 21:55:31,222 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 21:55:31,222 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:31,222 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:31,222 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 21:55:31,222 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:31,223 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:31,223 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:31,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:31,223 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:31,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:31,224 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:31,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:31,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,225 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,228 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:31,228 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:31,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:31,228 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:31,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 21:55:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:31,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 21:55:31,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:31,228 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,229 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:31,229 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:31,229 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,229 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:31,229 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:31,229 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:31,229 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:31,229 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:31,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:31,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:31,329 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:31,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:31,331 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:31,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:31,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:31,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:31,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:31,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 21:55:31,336 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 21:55:31,336 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:31,336 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 21:55:31,336 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 21:55:31,336 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:31,337 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:31,338 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:31,338 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:31,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:31,338 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:31,339 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:31,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:31,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:31,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 21:55:31,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 21:55:31,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 21:55:31,339 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 21:55:31,340 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:31,340 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 21:55:31,340 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:31,340 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. started... 2023-10-30 21:55:31,340 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 89ebfe6836789cb4975f6008a3b09078 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 21:55:31,340 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:31,340 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:31,340 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:31,340 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. started... 2023-10-30 21:55:31,340 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. started... 2023-10-30 21:55:31,340 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:31,341 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f370aafa6070d611274135fa479ee59f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 21:55:31,341 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 80f2ea819d0876ea7ac6b96623c135ef 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 21:55:31,359 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030e5d105d86eb14c63bb3a8aa5eb7c1ae3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030e5d105d86eb14c63bb3a8aa5eb7c1ae3 2023-10-30 21:55:31,360 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103065a7c4d83db1460fadb1250cf2f65ac8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023103065a7c4d83db1460fadb1250cf2f65ac8 2023-10-30 21:55:31,361 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030a69c7679576741cca0ea3a5c04841aa9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030a69c7679576741cca0ea3a5c04841aa9 2023-10-30 21:55:31,365 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/de0a6c865f334ddcab2019d2c4bc8d23 2023-10-30 21:55:31,370 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/468fd0790ae24f04bf2cdf04d4c9d720 2023-10-30 21:55:31,385 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030239562b140bd4d38a34be8fa2afc1130 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231030239562b140bd4d38a34be8fa2afc1130 2023-10-30 21:55:31,766 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/623eea6e552a40108477473ddc402b1c 2023-10-30 21:55:31,786 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103004ce8c0e2e34472da81331fa6c8f5e6c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023103004ce8c0e2e34472da81331fa6c8f5e6c 2023-10-30 21:55:31,789 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/f5b7476006e241eabd638e729cd887b2 2023-10-30 21:55:31,791 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/49cc7b4be12448e99021b3d4d8c548ab 2023-10-30 21:55:31,793 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/de0a6c865f334ddcab2019d2c4bc8d23 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/de0a6c865f334ddcab2019d2c4bc8d23 2023-10-30 21:55:31,794 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/468fd0790ae24f04bf2cdf04d4c9d720 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/468fd0790ae24f04bf2cdf04d4c9d720 2023-10-30 21:55:31,797 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/de0a6c865f334ddcab2019d2c4bc8d23, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 21:55:31,798 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/f5b7476006e241eabd638e729cd887b2 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/f5b7476006e241eabd638e729cd887b2 2023-10-30 21:55:31,798 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/468fd0790ae24f04bf2cdf04d4c9d720, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 21:55:31,798 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/49cc7b4be12448e99021b3d4d8c548ab as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/49cc7b4be12448e99021b3d4d8c548ab 2023-10-30 21:55:31,801 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/f5b7476006e241eabd638e729cd887b2, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 21:55:31,802 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/49cc7b4be12448e99021b3d4d8c548ab, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 21:55:31,802 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f370aafa6070d611274135fa479ee59f in 462ms, sequenceid=17, compaction requested=true 2023-10-30 21:55:31,802 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:55:31,802 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:31,802 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:31,803 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 89ebfe6836789cb4975f6008a3b09078 in 463ms, sequenceid=17, compaction requested=true 2023-10-30 21:55:31,803 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:55:31,803 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:31,803 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:32,181 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310300f63ce1d88bb411abcc0800b64b4bb0d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310300f63ce1d88bb411abcc0800b64b4bb0d 2023-10-30 21:55:32,586 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/2e685df111014ceab65971727638fb64 2023-10-30 21:55:32,591 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/623eea6e552a40108477473ddc402b1c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/623eea6e552a40108477473ddc402b1c 2023-10-30 21:55:32,594 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/623eea6e552a40108477473ddc402b1c, entries=4, sequenceid=17, filesize=5.4 K 2023-10-30 21:55:32,595 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/2e685df111014ceab65971727638fb64 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/2e685df111014ceab65971727638fb64 2023-10-30 21:55:32,599 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/2e685df111014ceab65971727638fb64, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 21:55:32,600 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 80f2ea819d0876ea7ac6b96623c135ef in 1259ms, sequenceid=17, compaction requested=true 2023-10-30 21:55:32,600 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:55:32,600 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:32,600 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:32,600 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:32,600 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,600 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 21:55:32,600 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 21:55:32,602 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:32,602 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:32,602 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:32,602 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:32,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:32,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:32,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:32,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:32,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 21:55:32,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51bc9b5d[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:32,604 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 21:55:32,604 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:32,605 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:32,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:32,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:32,605 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 21:55:32,605 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 21:55:32,605 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:32,605 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,605 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:32,607 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 21:55:32,607 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:32,607 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,607 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 21:55:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:32,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:32,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:32,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:32,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:32,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 21:55:32,610 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 21:55:32,610 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:32,610 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:32,610 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 21:55:32,610 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:32,611 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:32,611 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:32,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:32,611 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:32,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:32,612 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:32,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:32,613 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:32,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,615 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,615 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:32,615 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:32,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 21:55:32,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:32,615 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:32,615 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:32,615 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,616 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:32,615 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:32,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:32,616 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:32,616 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:32,616 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:32,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:32,616 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:32,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:32,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:32,716 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:32,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:32,728 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:32,739 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:32,751 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:32,752 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:32,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:32,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:32,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-30 21:55:32,783 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-30 21:55:32,783 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:32,783 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-30 21:55:32,783 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-30 21:55:32,784 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:32,784 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:32,785 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:32,785 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:32,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:32,785 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:32,785 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:32,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:32,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:32,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:32,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:32,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-30 21:55:32,786 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-30 21:55:32,786 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-30 21:55:32,786 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-30 21:55:32,786 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:32,786 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-30 21:55:32,786 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:32,786 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:32,786 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:32,786 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:32,786 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. started... 2023-10-30 21:55:32,786 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:32,786 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 80f2ea819d0876ea7ac6b96623c135ef 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 21:55:32,786 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. started... 2023-10-30 21:55:32,786 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. started... 2023-10-30 21:55:32,787 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 89ebfe6836789cb4975f6008a3b09078 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 21:55:32,787 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing f370aafa6070d611274135fa479ee59f 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 21:55:32,814 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/8b2e9d446cc44aaa87de55c8ebff873f 2023-10-30 21:55:32,817 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b2e9d446cc44aaa87de55c8ebff873f 2023-10-30 21:55:33,216 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/d6c1fc73ba25406d921dbe310aeee364 2023-10-30 21:55:33,220 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6c1fc73ba25406d921dbe310aeee364 2023-10-30 21:55:33,228 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/489d0ab15eea4d60b777a4b975d60907 2023-10-30 21:55:33,232 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 489d0ab15eea4d60b777a4b975d60907 2023-10-30 21:55:33,232 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/8b2e9d446cc44aaa87de55c8ebff873f as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/8b2e9d446cc44aaa87de55c8ebff873f 2023-10-30 21:55:33,235 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b2e9d446cc44aaa87de55c8ebff873f 2023-10-30 21:55:33,236 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/8b2e9d446cc44aaa87de55c8ebff873f, entries=3, sequenceid=23, filesize=5.0 K 2023-10-30 21:55:33,236 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/489d0ab15eea4d60b777a4b975d60907 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/489d0ab15eea4d60b777a4b975d60907 2023-10-30 21:55:33,240 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 489d0ab15eea4d60b777a4b975d60907 2023-10-30 21:55:33,240 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/489d0ab15eea4d60b777a4b975d60907, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 21:55:33,241 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f370aafa6070d611274135fa479ee59f in 454ms, sequenceid=23, compaction requested=true 2023-10-30 21:55:33,241 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:55:33,241 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:33,241 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:33,615 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/b2e0974e6b814102b7a43f8def45fa37 2023-10-30 21:55:33,619 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2e0974e6b814102b7a43f8def45fa37 2023-10-30 21:55:33,632 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/82f6205fea0d4ca39c9a73946c662ec7 2023-10-30 21:55:33,635 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82f6205fea0d4ca39c9a73946c662ec7 2023-10-30 21:55:33,636 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/d6c1fc73ba25406d921dbe310aeee364 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d6c1fc73ba25406d921dbe310aeee364 2023-10-30 21:55:33,639 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6c1fc73ba25406d921dbe310aeee364 2023-10-30 21:55:33,639 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d6c1fc73ba25406d921dbe310aeee364, entries=3, sequenceid=23, filesize=5.0 K 2023-10-30 21:55:33,640 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/82f6205fea0d4ca39c9a73946c662ec7 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/82f6205fea0d4ca39c9a73946c662ec7 2023-10-30 21:55:33,643 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82f6205fea0d4ca39c9a73946c662ec7 2023-10-30 21:55:33,643 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/82f6205fea0d4ca39c9a73946c662ec7, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 21:55:33,644 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 80f2ea819d0876ea7ac6b96623c135ef in 858ms, sequenceid=23, compaction requested=true 2023-10-30 21:55:33,644 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:55:33,644 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:33,644 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:34,431 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/d5589147ef7345a0ac00394fd55aaf3e 2023-10-30 21:55:34,435 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5589147ef7345a0ac00394fd55aaf3e 2023-10-30 21:55:34,436 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/b2e0974e6b814102b7a43f8def45fa37 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/b2e0974e6b814102b7a43f8def45fa37 2023-10-30 21:55:34,440 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2e0974e6b814102b7a43f8def45fa37 2023-10-30 21:55:34,440 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/b2e0974e6b814102b7a43f8def45fa37, entries=3, sequenceid=23, filesize=5.0 K 2023-10-30 21:55:34,440 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/d5589147ef7345a0ac00394fd55aaf3e as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/d5589147ef7345a0ac00394fd55aaf3e 2023-10-30 21:55:34,444 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5589147ef7345a0ac00394fd55aaf3e 2023-10-30 21:55:34,444 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/d5589147ef7345a0ac00394fd55aaf3e, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 21:55:34,445 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 89ebfe6836789cb4975f6008a3b09078 in 1658ms, sequenceid=23, compaction requested=true 2023-10-30 21:55:34,445 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:55:34,445 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:34,445 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:34,445 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:34,445 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,445 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-30 21:55:34,445 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-30 21:55:34,453 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,453 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:34,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:34,453 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:34,453 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:34,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-30 21:55:34,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@599c1e1d[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:34,455 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-30 21:55:34,455 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:34,456 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:34,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:34,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:34,456 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-30 21:55:34,456 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-30 21:55:34,456 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,456 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:34,456 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:34,457 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,457 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-30 21:55:34,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:34,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:34,457 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:34,457 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-30 21:55:34,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:34,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:34,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:34,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:34,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:34,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:34,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-30 21:55:34,460 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-30 21:55:34,460 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:34,460 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:34,460 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-30 21:55:34,460 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:34,464 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:34,464 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:34,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:34,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:34,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:34,464 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:34,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:34,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:34,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:34,465 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:34,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:34,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:34,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:34,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:34,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:34,466 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:34,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-30 21:55:34,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,468 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,468 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:34,468 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:34,468 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:34,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-30 21:55:34,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:34,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:34,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:34,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-30 21:55:34,468 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:34,468 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-30 21:55:34,469 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:34,469 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:34,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:34,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:34,469 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:34,469 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:34,469 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-30 21:55:34,469 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-30 21:55:34,569 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:34,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:34,570 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:34,570 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 89ebfe6836789cb4975f6008a3b09078/family1 is initiating major compaction (all files) 2023-10-30 21:55:34,571 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:34,571 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:34,571 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 89ebfe6836789cb4975f6008a3b09078/family1 in ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:34,571 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/9120026bd9ad4da98bc4591dd209960d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/5c3717d088e24eaa95b1be883e8441c7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/04e5ab429da14eefa2edd30afdbab53a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/468fd0790ae24f04bf2cdf04d4c9d720, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/b2e0974e6b814102b7a43f8def45fa37] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp, totalSize=26.6 K 2023-10-30 21:55:34,572 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 9120026bd9ad4da98bc4591dd209960d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702926312 2023-10-30 21:55:34,573 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 5c3717d088e24eaa95b1be883e8441c7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702928124 2023-10-30 21:55:34,573 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 04e5ab429da14eefa2edd30afdbab53a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702929930 2023-10-30 21:55:34,573 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 468fd0790ae24f04bf2cdf04d4c9d720, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702931332 2023-10-30 21:55:34,574 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting b2e0974e6b814102b7a43f8def45fa37, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:55:34,585 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 89ebfe6836789cb4975f6008a3b09078#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:34,994 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030ce521559bf104382836bd4f4947f121f_del 2023-10-30 21:55:34,994 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030ce521559bf104382836bd4f4947f121f_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030ce521559bf104382836bd4f4947f121f_del 2023-10-30 21:55:35,007 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20bfbe029547466faa155d0ae8b12f7a 2023-10-30 21:55:35,008 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family1/20bfbe029547466faa155d0ae8b12f7a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/20bfbe029547466faa155d0ae8b12f7a 2023-10-30 21:55:35,011 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20bfbe029547466faa155d0ae8b12f7a 2023-10-30 21:55:35,012 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 89ebfe6836789cb4975f6008a3b09078/family1 of 89ebfe6836789cb4975f6008a3b09078 into 20bfbe029547466faa155d0ae8b12f7a(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:55:35,012 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:55:35,012 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:35,013 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 89ebfe6836789cb4975f6008a3b09078/family2 is initiating major compaction (all files) 2023-10-30 21:55:35,013 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:35,013 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:35,013 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 89ebfe6836789cb4975f6008a3b09078/family2 in ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:55:35,014 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/7ac3962423b84e09b5eb588f965e4396, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/333de0c228c14e7bb28ad26d3adf10ed, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/2bb0f451315c47f2888492867a5ee490, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/49cc7b4be12448e99021b3d4d8c548ab, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/d5589147ef7345a0ac00394fd55aaf3e] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp, totalSize=25.3 K 2023-10-30 21:55:35,014 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 7ac3962423b84e09b5eb588f965e4396, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702926312 2023-10-30 21:55:35,014 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 333de0c228c14e7bb28ad26d3adf10ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702928124 2023-10-30 21:55:35,015 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 2bb0f451315c47f2888492867a5ee490, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702929930 2023-10-30 21:55:35,015 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 49cc7b4be12448e99021b3d4d8c548ab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702931332 2023-10-30 21:55:35,015 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting d5589147ef7345a0ac00394fd55aaf3e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:55:35,025 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 89ebfe6836789cb4975f6008a3b09078#family2#compaction#151 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:35,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/9120026bd9ad4da98bc4591dd209960d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/5c3717d088e24eaa95b1be883e8441c7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/04e5ab429da14eefa2edd30afdbab53a, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/468fd0790ae24f04bf2cdf04d4c9d720, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/b2e0974e6b814102b7a43f8def45fa37] to archive 2023-10-30 21:55:35,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:35,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/9120026bd9ad4da98bc4591dd209960d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/9120026bd9ad4da98bc4591dd209960d 2023-10-30 21:55:35,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/5c3717d088e24eaa95b1be883e8441c7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/5c3717d088e24eaa95b1be883e8441c7 2023-10-30 21:55:35,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/04e5ab429da14eefa2edd30afdbab53a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/04e5ab429da14eefa2edd30afdbab53a 2023-10-30 21:55:35,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/468fd0790ae24f04bf2cdf04d4c9d720 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/468fd0790ae24f04bf2cdf04d4c9d720 2023-10-30 21:55:35,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/b2e0974e6b814102b7a43f8def45fa37 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/b2e0974e6b814102b7a43f8def45fa37 2023-10-30 21:55:35,434 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030298ea784465b43f786a81ab2341fda73_del 2023-10-30 21:55:35,434 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030298ea784465b43f786a81ab2341fda73_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231030298ea784465b43f786a81ab2341fda73_del 2023-10-30 21:55:36,248 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f192c9e2e7164d868e64b2bea312fa54 2023-10-30 21:55:36,249 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/.tmp/family2/f192c9e2e7164d868e64b2bea312fa54 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/f192c9e2e7164d868e64b2bea312fa54 2023-10-30 21:55:36,252 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f192c9e2e7164d868e64b2bea312fa54 2023-10-30 21:55:36,253 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 89ebfe6836789cb4975f6008a3b09078/family2 of 89ebfe6836789cb4975f6008a3b09078 into f192c9e2e7164d868e64b2bea312fa54(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:36,253 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:55:36,254 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:36,254 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 80f2ea819d0876ea7ac6b96623c135ef/family1 is initiating major compaction (all files) 2023-10-30 21:55:36,254 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:36,254 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:36,254 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 80f2ea819d0876ea7ac6b96623c135ef/family1 in ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:36,255 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d273a58379cc43369e4c7b8ee26ff7af, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/3b3d2cf2d48e4532b43bd97fc8eb6580, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/578e5f57a19d4f04b26132d5768a9831, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/623eea6e552a40108477473ddc402b1c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d6c1fc73ba25406d921dbe310aeee364] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp, totalSize=26.6 K 2023-10-30 21:55:36,255 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting d273a58379cc43369e4c7b8ee26ff7af, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702926311 2023-10-30 21:55:36,255 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 3b3d2cf2d48e4532b43bd97fc8eb6580, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702928124 2023-10-30 21:55:36,256 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 578e5f57a19d4f04b26132d5768a9831, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702929930 2023-10-30 21:55:36,256 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 623eea6e552a40108477473ddc402b1c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702931331 2023-10-30 21:55:36,256 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting d6c1fc73ba25406d921dbe310aeee364, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:55:36,266 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 80f2ea819d0876ea7ac6b96623c135ef#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:36,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/7ac3962423b84e09b5eb588f965e4396, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/333de0c228c14e7bb28ad26d3adf10ed, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/2bb0f451315c47f2888492867a5ee490, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/49cc7b4be12448e99021b3d4d8c548ab, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/d5589147ef7345a0ac00394fd55aaf3e] to archive 2023-10-30 21:55:36,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:36,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/7ac3962423b84e09b5eb588f965e4396 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/7ac3962423b84e09b5eb588f965e4396 2023-10-30 21:55:36,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/333de0c228c14e7bb28ad26d3adf10ed to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/333de0c228c14e7bb28ad26d3adf10ed 2023-10-30 21:55:36,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/2bb0f451315c47f2888492867a5ee490 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/2bb0f451315c47f2888492867a5ee490 2023-10-30 21:55:36,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/49cc7b4be12448e99021b3d4d8c548ab to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/49cc7b4be12448e99021b3d4d8c548ab 2023-10-30 21:55:36,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/d5589147ef7345a0ac00394fd55aaf3e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family2/d5589147ef7345a0ac00394fd55aaf3e 2023-10-30 21:55:36,678 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310301178d78a2548449498b5d7835841fb5e_del 2023-10-30 21:55:36,679 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310301178d78a2548449498b5d7835841fb5e_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310301178d78a2548449498b5d7835841fb5e_del 2023-10-30 21:55:37,492 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3597a1668d54ea6aca7d6afea2dc021 2023-10-30 21:55:37,493 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family1/c3597a1668d54ea6aca7d6afea2dc021 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/c3597a1668d54ea6aca7d6afea2dc021 2023-10-30 21:55:37,497 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3597a1668d54ea6aca7d6afea2dc021 2023-10-30 21:55:37,498 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 80f2ea819d0876ea7ac6b96623c135ef/family1 of 80f2ea819d0876ea7ac6b96623c135ef into c3597a1668d54ea6aca7d6afea2dc021(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:37,498 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:55:37,498 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:37,498 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 80f2ea819d0876ea7ac6b96623c135ef/family2 is initiating major compaction (all files) 2023-10-30 21:55:37,498 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:37,499 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:37,499 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 80f2ea819d0876ea7ac6b96623c135ef/family2 in ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:55:37,499 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8e1dfa7dfeea40249dbccd271dcf0b7f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8c714a74d98c4b1785c53f3eaa078c00, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/08e67e6987764bac9cd99db641aeec43, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/2e685df111014ceab65971727638fb64, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/82f6205fea0d4ca39c9a73946c662ec7] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp, totalSize=25.3 K 2023-10-30 21:55:37,499 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 8e1dfa7dfeea40249dbccd271dcf0b7f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702926311 2023-10-30 21:55:37,500 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 8c714a74d98c4b1785c53f3eaa078c00, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702928124 2023-10-30 21:55:37,500 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 08e67e6987764bac9cd99db641aeec43, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702929930 2023-10-30 21:55:37,500 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 2e685df111014ceab65971727638fb64, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702931331 2023-10-30 21:55:37,501 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 82f6205fea0d4ca39c9a73946c662ec7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:55:37,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d273a58379cc43369e4c7b8ee26ff7af, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/3b3d2cf2d48e4532b43bd97fc8eb6580, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/578e5f57a19d4f04b26132d5768a9831, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/623eea6e552a40108477473ddc402b1c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d6c1fc73ba25406d921dbe310aeee364] to archive 2023-10-30 21:55:37,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:37,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d273a58379cc43369e4c7b8ee26ff7af to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d273a58379cc43369e4c7b8ee26ff7af 2023-10-30 21:55:37,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/3b3d2cf2d48e4532b43bd97fc8eb6580 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/3b3d2cf2d48e4532b43bd97fc8eb6580 2023-10-30 21:55:37,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/578e5f57a19d4f04b26132d5768a9831 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/578e5f57a19d4f04b26132d5768a9831 2023-10-30 21:55:37,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/623eea6e552a40108477473ddc402b1c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/623eea6e552a40108477473ddc402b1c 2023-10-30 21:55:37,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d6c1fc73ba25406d921dbe310aeee364 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/d6c1fc73ba25406d921dbe310aeee364 2023-10-30 21:55:37,514 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 80f2ea819d0876ea7ac6b96623c135ef#family2#compaction#153 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:37,922 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030fa22d0cd7e594805a37725809d8e7c1c_del 2023-10-30 21:55:37,922 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030fa22d0cd7e594805a37725809d8e7c1c_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231030fa22d0cd7e594805a37725809d8e7c1c_del 2023-10-30 21:55:38,735 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d72a49ebbf34aaa97c7ef1a0ea49359 2023-10-30 21:55:38,736 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/.tmp/family2/7d72a49ebbf34aaa97c7ef1a0ea49359 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/7d72a49ebbf34aaa97c7ef1a0ea49359 2023-10-30 21:55:38,740 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d72a49ebbf34aaa97c7ef1a0ea49359 2023-10-30 21:55:38,741 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 80f2ea819d0876ea7ac6b96623c135ef/family2 of 80f2ea819d0876ea7ac6b96623c135ef into 7d72a49ebbf34aaa97c7ef1a0ea49359(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:38,741 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:55:38,741 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:38,741 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): f370aafa6070d611274135fa479ee59f/family1 is initiating major compaction (all files) 2023-10-30 21:55:38,741 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:38,741 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:38,741 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of f370aafa6070d611274135fa479ee59f/family1 in ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:38,742 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/ffe0c402f7d44e36a49c3e7980f5c6fa, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/bd59ce5921984ecf9406b362cfea871c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/85b42bff21db47a0bd58fb7a82ea3686, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/de0a6c865f334ddcab2019d2c4bc8d23, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/8b2e9d446cc44aaa87de55c8ebff873f] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp, totalSize=26.6 K 2023-10-30 21:55:38,742 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting ffe0c402f7d44e36a49c3e7980f5c6fa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702926312 2023-10-30 21:55:38,742 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting bd59ce5921984ecf9406b362cfea871c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702928124 2023-10-30 21:55:38,743 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 85b42bff21db47a0bd58fb7a82ea3686, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702929930 2023-10-30 21:55:38,743 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting de0a6c865f334ddcab2019d2c4bc8d23, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702931332 2023-10-30 21:55:38,743 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 8b2e9d446cc44aaa87de55c8ebff873f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:55:38,752 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): f370aafa6070d611274135fa479ee59f#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:38,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8e1dfa7dfeea40249dbccd271dcf0b7f, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8c714a74d98c4b1785c53f3eaa078c00, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/08e67e6987764bac9cd99db641aeec43, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/2e685df111014ceab65971727638fb64, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/82f6205fea0d4ca39c9a73946c662ec7] to archive 2023-10-30 21:55:38,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:38,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8e1dfa7dfeea40249dbccd271dcf0b7f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8e1dfa7dfeea40249dbccd271dcf0b7f 2023-10-30 21:55:38,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8c714a74d98c4b1785c53f3eaa078c00 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/8c714a74d98c4b1785c53f3eaa078c00 2023-10-30 21:55:38,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/08e67e6987764bac9cd99db641aeec43 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/08e67e6987764bac9cd99db641aeec43 2023-10-30 21:55:38,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/2e685df111014ceab65971727638fb64 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/2e685df111014ceab65971727638fb64 2023-10-30 21:55:38,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/82f6205fea0d4ca39c9a73946c662ec7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family2/82f6205fea0d4ca39c9a73946c662ec7 2023-10-30 21:55:39,159 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030ca20fde86c7144a294dddc91d4fb11c7_del 2023-10-30 21:55:39,160 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030ca20fde86c7144a294dddc91d4fb11c7_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231030ca20fde86c7144a294dddc91d4fb11c7_del 2023-10-30 21:55:39,973 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8054d892dbd44690b45991952f714914 2023-10-30 21:55:39,973 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family1/8054d892dbd44690b45991952f714914 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/8054d892dbd44690b45991952f714914 2023-10-30 21:55:39,977 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8054d892dbd44690b45991952f714914 2023-10-30 21:55:39,978 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f370aafa6070d611274135fa479ee59f/family1 of f370aafa6070d611274135fa479ee59f into 8054d892dbd44690b45991952f714914(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:39,978 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:55:39,978 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:55:39,978 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): f370aafa6070d611274135fa479ee59f/family2 is initiating major compaction (all files) 2023-10-30 21:55:39,978 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:55:39,978 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:55:39,978 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of f370aafa6070d611274135fa479ee59f/family2 in ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:55:39,978 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/cdf2373399434ced8947fabe7b0b008e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/0255d39dc30f46a19e09426d52b4a614, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/8cd883e5a07949599db157904b247a20, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/f5b7476006e241eabd638e729cd887b2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/489d0ab15eea4d60b777a4b975d60907] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp, totalSize=25.3 K 2023-10-30 21:55:39,979 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting cdf2373399434ced8947fabe7b0b008e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702926312 2023-10-30 21:55:39,979 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 0255d39dc30f46a19e09426d52b4a614, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702928124 2023-10-30 21:55:39,979 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 8cd883e5a07949599db157904b247a20, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702929930 2023-10-30 21:55:39,980 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting f5b7476006e241eabd638e729cd887b2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702931332 2023-10-30 21:55:39,980 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 489d0ab15eea4d60b777a4b975d60907, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:55:39,988 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): f370aafa6070d611274135fa479ee59f#family2#compaction#155 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:40,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/ffe0c402f7d44e36a49c3e7980f5c6fa, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/bd59ce5921984ecf9406b362cfea871c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/85b42bff21db47a0bd58fb7a82ea3686, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/de0a6c865f334ddcab2019d2c4bc8d23, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/8b2e9d446cc44aaa87de55c8ebff873f] to archive 2023-10-30 21:55:40,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:40,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/ffe0c402f7d44e36a49c3e7980f5c6fa to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/ffe0c402f7d44e36a49c3e7980f5c6fa 2023-10-30 21:55:40,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/bd59ce5921984ecf9406b362cfea871c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/bd59ce5921984ecf9406b362cfea871c 2023-10-30 21:55:40,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/85b42bff21db47a0bd58fb7a82ea3686 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/85b42bff21db47a0bd58fb7a82ea3686 2023-10-30 21:55:40,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/de0a6c865f334ddcab2019d2c4bc8d23 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/de0a6c865f334ddcab2019d2c4bc8d23 2023-10-30 21:55:40,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/8b2e9d446cc44aaa87de55c8ebff873f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/8b2e9d446cc44aaa87de55c8ebff873f 2023-10-30 21:55:40,395 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030c7c9d46bde8e460f83a481d1b0626c4c_del 2023-10-30 21:55:40,396 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030c7c9d46bde8e460f83a481d1b0626c4c_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231030c7c9d46bde8e460f83a481d1b0626c4c_del 2023-10-30 21:55:41,212 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80a8a3faf92049b5bb53484f60d0f512 2023-10-30 21:55:41,213 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/.tmp/family2/80a8a3faf92049b5bb53484f60d0f512 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/80a8a3faf92049b5bb53484f60d0f512 2023-10-30 21:55:41,217 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 80a8a3faf92049b5bb53484f60d0f512 2023-10-30 21:55:41,218 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f370aafa6070d611274135fa479ee59f/family2 of f370aafa6070d611274135fa479ee59f into 80a8a3faf92049b5bb53484f60d0f512(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:41,218 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:55:41,221 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:41,224 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:41,227 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:41,227 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:41,233 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 21:55:41,246 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-10-30 21:55:41,249 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310301178d78a2548449498b5d7835841fb5e_del 2023-10-30 21:55:41,251 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231030ce521559bf104382836bd4f4947f121f_del 2023-10-30 21:55:41,254 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030ca20fde86c7144a294dddc91d4fb11c7_del 2023-10-30 21:55:41,254 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-10-30 21:55:41,255 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(139): Connect 0x450b5a60 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:55:41,259 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cd1814d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:55:41,260 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 21:55:41,260 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 21:55:41,260 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 21:55:41,285 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103079b368cfa1964d9db24452d49e127628 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023103079b368cfa1964d9db24452d49e127628 2023-10-30 21:55:41,286 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 21:55:41,298 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:55:41,301 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:55:41,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/cdf2373399434ced8947fabe7b0b008e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/0255d39dc30f46a19e09426d52b4a614, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/8cd883e5a07949599db157904b247a20, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/f5b7476006e241eabd638e729cd887b2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/489d0ab15eea4d60b777a4b975d60907] to archive 2023-10-30 21:55:41,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:41,307 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:55:41,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/cdf2373399434ced8947fabe7b0b008e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/cdf2373399434ced8947fabe7b0b008e 2023-10-30 21:55:41,310 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:55:41,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/0255d39dc30f46a19e09426d52b4a614 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/0255d39dc30f46a19e09426d52b4a614 2023-10-30 21:55:41,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/8cd883e5a07949599db157904b247a20 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/8cd883e5a07949599db157904b247a20 2023-10-30 21:55:41,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/f5b7476006e241eabd638e729cd887b2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/f5b7476006e241eabd638e729cd887b2 2023-10-30 21:55:41,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/489d0ab15eea4d60b777a4b975d60907 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family2/489d0ab15eea4d60b777a4b975d60907 2023-10-30 21:55:41,334 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/9b77824f183643eab2bf1540397d4acd first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-10-30 21:55:41,334 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/9b77824f183643eab2bf1540397d4acd}] 2023-10-30 21:55:41,339 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/9b77824f183643eab2bf1540397d4acd for inclusion in 80f2ea819d0876ea7ac6b96623c135ef/family1 2023-10-30 21:55:41,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-10-30 21:55:41,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 21:55:41,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:55:41,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030/family1/9b77824f183643eab2bf1540397d4acd to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__l6ejbn0p7dtlhg6i5c8hiaubu9v1jsob3gc0stf5cmij3t33mtubagak2jg6h8uh/family1/9b77824f183643eab2bf1540397d4acd 2023-10-30 21:55:41,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__l6ejbn0p7dtlhg6i5c8hiaubu9v1jsob3gc0stf5cmij3t33mtubagak2jg6h8uh/family1/9b77824f183643eab2bf1540397d4acd as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/1d0c15f04bbe451bafeac18baedb0c43_SeqId_28_ 2023-10-30 21:55:41,346 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__l6ejbn0p7dtlhg6i5c8hiaubu9v1jsob3gc0stf5cmij3t33mtubagak2jg6h8uh/family1/9b77824f183643eab2bf1540397d4acd into 80f2ea819d0876ea7ac6b96623c135ef/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/1d0c15f04bbe451bafeac18baedb0c43_SeqId_28_ - updating store file list. 2023-10-30 21:55:41,353 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/1d0c15f04bbe451bafeac18baedb0c43_SeqId_28_ into 80f2ea819d0876ea7ac6b96623c135ef/family1 2023-10-30 21:55:41,353 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__l6ejbn0p7dtlhg6i5c8hiaubu9v1jsob3gc0stf5cmij3t33mtubagak2jg6h8uh/family1/9b77824f183643eab2bf1540397d4acd into 80f2ea819d0876ea7ac6b96623c135ef/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/family1/1d0c15f04bbe451bafeac18baedb0c43_SeqId_28_) 2023-10-30 21:55:41,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__l6ejbn0p7dtlhg6i5c8hiaubu9v1jsob3gc0stf5cmij3t33mtubagak2jg6h8uh/family1/9b77824f183643eab2bf1540397d4acd 2023-10-30 21:55:41,355 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 21:55:41,356 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:41,357 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310304e69966a74c94cc1b6e6c3dd8adb1fc6 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310304e69966a74c94cc1b6e6c3dd8adb1fc6 2023-10-30 21:55:41,358 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-30 21:55:41,358 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 21:55:41,358 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 21:55:42,088 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030ddd4db04cbcb4be2a98414c8444fa8dc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231030ddd4db04cbcb4be2a98414c8444fa8dc 2023-10-30 21:55:42,089 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310306baf8c57db634833a5d728fb1ca7199c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202310306baf8c57db634833a5d728fb1ca7199c 2023-10-30 21:55:42,089 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 21:55:42,089 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 21:55:42,119 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/a939df2faba943958a337f6bb46b00f7 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-10-30 21:55:42,119 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/a939df2faba943958a337f6bb46b00f7}] 2023-10-30 21:55:42,120 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/aeee67c83a4a4128be4bcb6dfd39c5f6 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-10-30 21:55:42,120 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/aeee67c83a4a4128be4bcb6dfd39c5f6}] 2023-10-30 21:55:42,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/a939df2faba943958a337f6bb46b00f7 for inclusion in 89ebfe6836789cb4975f6008a3b09078/family1 2023-10-30 21:55:42,122 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/aeee67c83a4a4128be4bcb6dfd39c5f6 for inclusion in f370aafa6070d611274135fa479ee59f/family1 2023-10-30 21:55:42,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-10-30 21:55:42,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 21:55:42,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-10-30 21:55:42,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:55:42,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 21:55:42,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:55:42,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030/family1/aeee67c83a4a4128be4bcb6dfd39c5f6 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__lv32cf0jhs9b5th16tbifa7pr2j9mirljbpraaqd214ie7oflaopipf7si48i3rn/family1/aeee67c83a4a4128be4bcb6dfd39c5f6 2023-10-30 21:55:42,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030/family1/a939df2faba943958a337f6bb46b00f7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__dk5ndtjkm520fhqdc19igic1fgqt1m735ul2d8hf2vj3uf9u9ah30db3elso6r7k/family1/a939df2faba943958a337f6bb46b00f7 2023-10-30 21:55:42,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__lv32cf0jhs9b5th16tbifa7pr2j9mirljbpraaqd214ie7oflaopipf7si48i3rn/family1/aeee67c83a4a4128be4bcb6dfd39c5f6 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/924b2a2ce2824f0198970dad64ea08c9_SeqId_28_ 2023-10-30 21:55:42,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__dk5ndtjkm520fhqdc19igic1fgqt1m735ul2d8hf2vj3uf9u9ah30db3elso6r7k/family1/a939df2faba943958a337f6bb46b00f7 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/70cb356acafe417282d76d5644ce20a1_SeqId_28_ 2023-10-30 21:55:42,128 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__lv32cf0jhs9b5th16tbifa7pr2j9mirljbpraaqd214ie7oflaopipf7si48i3rn/family1/aeee67c83a4a4128be4bcb6dfd39c5f6 into f370aafa6070d611274135fa479ee59f/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/924b2a2ce2824f0198970dad64ea08c9_SeqId_28_ - updating store file list. 2023-10-30 21:55:42,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__dk5ndtjkm520fhqdc19igic1fgqt1m735ul2d8hf2vj3uf9u9ah30db3elso6r7k/family1/a939df2faba943958a337f6bb46b00f7 into 89ebfe6836789cb4975f6008a3b09078/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/70cb356acafe417282d76d5644ce20a1_SeqId_28_ - updating store file list. 2023-10-30 21:55:42,132 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/924b2a2ce2824f0198970dad64ea08c9_SeqId_28_ into f370aafa6070d611274135fa479ee59f/family1 2023-10-30 21:55:42,132 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__lv32cf0jhs9b5th16tbifa7pr2j9mirljbpraaqd214ie7oflaopipf7si48i3rn/family1/aeee67c83a4a4128be4bcb6dfd39c5f6 into f370aafa6070d611274135fa479ee59f/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/family1/924b2a2ce2824f0198970dad64ea08c9_SeqId_28_) 2023-10-30 21:55:42,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/70cb356acafe417282d76d5644ce20a1_SeqId_28_ into 89ebfe6836789cb4975f6008a3b09078/family1 2023-10-30 21:55:42,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__dk5ndtjkm520fhqdc19igic1fgqt1m735ul2d8hf2vj3uf9u9ah30db3elso6r7k/family1/a939df2faba943958a337f6bb46b00f7 into 89ebfe6836789cb4975f6008a3b09078/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/family1/70cb356acafe417282d76d5644ce20a1_SeqId_28_) 2023-10-30 21:55:42,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__lv32cf0jhs9b5th16tbifa7pr2j9mirljbpraaqd214ie7oflaopipf7si48i3rn/family1/aeee67c83a4a4128be4bcb6dfd39c5f6 2023-10-30 21:55:42,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__ns_testMinorCompaction__dk5ndtjkm520fhqdc19igic1fgqt1m735ul2d8hf2vj3uf9u9ah30db3elso6r7k/family1/a939df2faba943958a337f6bb46b00f7 2023-10-30 21:55:42,134 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 21:55:42,134 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='ns:testMinorCompaction' column='family1' 2023-10-30 21:55:42,134 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:42,134 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:42,136 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023103018a4e3d1759b41b8b1fba64197ffe24d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023103018a4e3d1759b41b8b1fba64197ffe24d 2023-10-30 21:55:42,136 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310306f42095679364b53a77a193b0ce858d5 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310306f42095679364b53a77a193b0ce858d5 2023-10-30 21:55:42,136 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-30 21:55:42,136 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-30 21:55:42,136 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 21:55:42,136 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 21:55:42,136 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 21:55:42,136 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='ns:testMinorCompaction' and column='family1' 2023-10-30 21:55:42,136 INFO [Listener at localhost/36139] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-10-30 21:55:42,139 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:42,140 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:42,143 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:55:42,144 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:55:42,160 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=256 (was 288), OpenFileDescriptor=652 (was 768), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=257 (was 256) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=15176 (was 14705) - AvailableMemoryMB LEAK? - 2023-10-30 21:55:42,171 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=256, OpenFileDescriptor=652, MaxFileDescriptor=60000, SystemLoadAverage=257, ProcessCount=167, AvailableMemoryMB=15176 2023-10-30 21:55:42,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-30 21:55:42,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:42,175 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:55:42,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-10-30 21:55:42,186 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:55:42,187 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79cc659a to 127.0.0.1:56981 2023-10-30 21:55:42,187 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:55:42,188 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:55:42,188 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:55:42,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 21:55:42,189 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x450b5a60 to 127.0.0.1:56981 2023-10-30 21:55:42,189 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:55:42,190 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366 2023-10-30 21:55:42,190 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366 empty. 2023-10-30 21:55:42,191 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366 2023-10-30 21:55:42,191 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-10-30 21:55:42,191 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:55:42,191 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71190d3d to 127.0.0.1:56981 2023-10-30 21:55:42,191 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:55:42,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 21:55:42,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 21:55:42,598 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-30 21:55:42,599 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 059490245c09fc93a3f34853d7b38366, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:55:42,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 21:55:43,004 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:43,004 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 059490245c09fc93a3f34853d7b38366, disabling compactions & flushes 2023-10-30 21:55:43,004 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:43,004 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:43,004 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. after waiting 0 ms 2023-10-30 21:55:43,004 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:43,004 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:43,004 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:43,006 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:55:43,007 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698702943007"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702943007"}]},"ts":"1698702943007"} 2023-10-30 21:55:43,008 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-30 21:55:43,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:55:43,009 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702943009"}]},"ts":"1698702943009"} 2023-10-30 21:55:43,010 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-30 21:55:43,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=059490245c09fc93a3f34853d7b38366, ASSIGN}] 2023-10-30 21:55:43,014 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=059490245c09fc93a3f34853d7b38366, ASSIGN 2023-10-30 21:55:43,014 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=059490245c09fc93a3f34853d7b38366, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:55:43,165 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=059490245c09fc93a3f34853d7b38366, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:43,165 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698702943165"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702943165"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702943165"}]},"ts":"1698702943165"} 2023-10-30 21:55:43,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 059490245c09fc93a3f34853d7b38366, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:43,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 21:55:43,318 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:43,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:43,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 059490245c09fc93a3f34853d7b38366, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366.', STARTKEY => '', ENDKEY => ''} 2023-10-30 21:55:43,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 059490245c09fc93a3f34853d7b38366 2023-10-30 21:55:43,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:43,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 059490245c09fc93a3f34853d7b38366 2023-10-30 21:55:43,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 059490245c09fc93a3f34853d7b38366 2023-10-30 21:55:43,322 INFO [StoreOpener-059490245c09fc93a3f34853d7b38366-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 059490245c09fc93a3f34853d7b38366 2023-10-30 21:55:43,323 DEBUG [StoreOpener-059490245c09fc93a3f34853d7b38366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1 2023-10-30 21:55:43,323 DEBUG [StoreOpener-059490245c09fc93a3f34853d7b38366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1 2023-10-30 21:55:43,324 INFO [StoreOpener-059490245c09fc93a3f34853d7b38366-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 059490245c09fc93a3f34853d7b38366 columnFamilyName family1 2023-10-30 21:55:43,325 INFO [StoreOpener-059490245c09fc93a3f34853d7b38366-1] regionserver.HStore(310): Store=059490245c09fc93a3f34853d7b38366/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:43,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366 2023-10-30 21:55:43,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366 2023-10-30 21:55:43,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 059490245c09fc93a3f34853d7b38366 2023-10-30 21:55:43,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:55:43,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 059490245c09fc93a3f34853d7b38366; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75206790, jitterRate=0.12066850066184998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-30 21:55:43,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:43,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366., pid=114, masterSystemTime=1698702943318 2023-10-30 21:55:43,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:43,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:43,332 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=059490245c09fc93a3f34853d7b38366, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:43,332 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698702943332"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702943332"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702943332"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702943332"}]},"ts":"1698702943332"} 2023-10-30 21:55:43,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-10-30 21:55:43,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 059490245c09fc93a3f34853d7b38366, server=jenkins-hbase4.apache.org,44371,1698702798019 in 166 msec 2023-10-30 21:55:43,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-10-30 21:55:43,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=059490245c09fc93a3f34853d7b38366, ASSIGN in 323 msec 2023-10-30 21:55:43,336 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:55:43,337 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702943336"}]},"ts":"1698702943336"} 2023-10-30 21:55:43,337 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-30 21:55:43,339 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:55:43,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1660 sec 2023-10-30 21:55:44,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-30 21:55:44,294 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-10-30 21:55:44,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:44,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,317 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:44,317 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:44,317 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:55:44,317 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:55:44,317 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,317 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,320 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,320 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:44,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:44,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:44,320 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,320 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:44,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,321 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,322 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,322 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:55:44,322 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:44,322 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:55:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:55:44,323 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:44,323 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:44,323 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. started... 2023-10-30 21:55:44,324 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059490245c09fc93a3f34853d7b38366 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-30 21:55:44,344 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307403f520e3154796bce7b35514dcad7d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511307403f520e3154796bce7b35514dcad7d 2023-10-30 21:55:44,748 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/dff13b5c373d4034ba93893ec848f45c 2023-10-30 21:55:44,752 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/dff13b5c373d4034ba93893ec848f45c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/dff13b5c373d4034ba93893ec848f45c 2023-10-30 21:55:44,755 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/dff13b5c373d4034ba93893ec848f45c, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-30 21:55:44,756 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 059490245c09fc93a3f34853d7b38366 in 433ms, sequenceid=5, compaction requested=false 2023-10-30 21:55:44,756 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:44,756 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:44,756 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:44,756 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:55:44,757 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:55:44,757 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,757 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:55:44,757 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:55:44,758 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,758 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:44,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:44,758 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,758 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:44,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:44,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:44,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:44,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:55:44,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@305ad865[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:44,760 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:55:44,760 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,761 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,761 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:55:44,761 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:55:44,761 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:44,761 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,761 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:44,762 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:55:44,762 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:44,762 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,762 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:55:44,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:44,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:44,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:44,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:44,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:44,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:44,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:55:44,764 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:55:44,764 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:44,764 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:44,764 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,764 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:44,772 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,772 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,772 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:44,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:44,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:44,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:44,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:44,772 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:44,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,774 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:44,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,776 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:44,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:44,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:44,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:44,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:44,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:44,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:44,776 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,777 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:44,777 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:44,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:44,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:44,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:55:44,877 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:44,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:44,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:44,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:44,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,884 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:44,884 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:44,884 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:55:44,884 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:55:44,884 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,884 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,885 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:44,886 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:44,886 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:44,886 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,887 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,887 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:55:44,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:55:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:55:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:55:44,887 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:44,887 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:44,887 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. started... 2023-10-30 21:55:44,887 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059490245c09fc93a3f34853d7b38366 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-30 21:55:44,901 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287964a80bc08a447aa8cd6128ec8dbf94 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511287964a80bc08a447aa8cd6128ec8dbf94 2023-10-30 21:55:45,306 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/ac1678deb1df4ad088e2b5b33b6e52fd 2023-10-30 21:55:45,311 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/ac1678deb1df4ad088e2b5b33b6e52fd as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/ac1678deb1df4ad088e2b5b33b6e52fd 2023-10-30 21:55:45,314 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/ac1678deb1df4ad088e2b5b33b6e52fd, entries=1, sequenceid=9, filesize=5.0 K 2023-10-30 21:55:45,315 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 059490245c09fc93a3f34853d7b38366 in 428ms, sequenceid=9, compaction requested=false 2023-10-30 21:55:45,315 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:45,315 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:45,315 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:55:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:55:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:55:45,316 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:55:45,317 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,317 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:45,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:45,317 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,318 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:45,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:55:45,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14cbdd66[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:45,319 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:55:45,319 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,321 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,321 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:55:45,321 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:55:45,321 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:45,321 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,321 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:45,322 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:55:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:45,323 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:55:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:45,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:55:45,325 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:55:45,325 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:45,325 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:45,325 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,325 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:45,327 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,327 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,327 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:45,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:45,327 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:45,328 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,330 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,330 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:45,330 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:45,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:45,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:45,330 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:45,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:45,331 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:45,330 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,331 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:45,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,331 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:55:45,331 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:45,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:45,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:45,431 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:45,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:45,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:45,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:45,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,437 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:45,437 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:45,438 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:55:45,438 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:55:45,438 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,438 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,444 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:45,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:45,444 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:45,444 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:45,444 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:55:45,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:45,446 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:55:45,446 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:45,446 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:55:45,446 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:55:45,446 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:45,446 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:45,446 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. started... 2023-10-30 21:55:45,446 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059490245c09fc93a3f34853d7b38366 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:55:45,857 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018e0cd41ac4914eff980601ffd0d465bd to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512018e0cd41ac4914eff980601ffd0d465bd 2023-10-30 21:55:46,262 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/2af1af46b50f423dba9e44e04cf18db1 2023-10-30 21:55:46,267 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/2af1af46b50f423dba9e44e04cf18db1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/2af1af46b50f423dba9e44e04cf18db1 2023-10-30 21:55:46,271 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/2af1af46b50f423dba9e44e04cf18db1, entries=1, sequenceid=13, filesize=4.9 K 2023-10-30 21:55:46,271 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059490245c09fc93a3f34853d7b38366 in 825ms, sequenceid=13, compaction requested=true 2023-10-30 21:55:46,272 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:46,272 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:46,272 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:55:46,272 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:55:46,272 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,272 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:55:46,272 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:55:46,273 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,273 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:46,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:46,274 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,274 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:46,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:46,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:46,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:46,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:55:46,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2198dad1[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:46,275 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:55:46,275 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,276 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,277 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:55:46,277 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:55:46,277 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:46,277 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,277 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:46,278 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:55:46,278 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:46,278 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,278 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:55:46,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:46,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:46,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:46,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:46,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:46,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:55:46,280 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:55:46,280 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:46,280 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:46,280 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,280 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:46,283 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,283 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,283 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:46,284 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:46,285 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:46,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:46,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:46,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:46,288 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,288 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,288 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:46,288 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:46,288 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:46,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:46,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:46,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:55:46,388 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:46,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:46,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:46,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:46,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,394 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:46,394 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:46,394 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:55:46,394 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:55:46,395 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,395 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,396 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:46,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:46,396 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:46,396 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:46,396 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:46,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:46,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,397 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,397 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:55:46,397 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:46,397 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:55:46,398 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:46,398 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:55:46,398 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:55:46,398 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:46,398 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:46,398 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. started... 2023-10-30 21:55:46,398 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059490245c09fc93a3f34853d7b38366 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:55:46,811 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205da47a3ce7e5549c4bd22908f79341839 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205da47a3ce7e5549c4bd22908f79341839 2023-10-30 21:55:47,219 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/bf8fdfa5b5884e9994810e0c1e8433af 2023-10-30 21:55:47,223 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/bf8fdfa5b5884e9994810e0c1e8433af as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/bf8fdfa5b5884e9994810e0c1e8433af 2023-10-30 21:55:47,226 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/bf8fdfa5b5884e9994810e0c1e8433af, entries=1, sequenceid=17, filesize=4.9 K 2023-10-30 21:55:47,227 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059490245c09fc93a3f34853d7b38366 in 829ms, sequenceid=17, compaction requested=true 2023-10-30 21:55:47,227 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:47,227 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:47,227 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:55:47,228 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:55:47,228 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,228 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:55:47,228 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:55:47,229 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,229 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:47,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:47,230 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,230 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:47,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:55:47,231 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:55:47,231 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18cd5409[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:47,233 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,233 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:55:47,233 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:55:47,233 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:47,233 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,233 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:47,234 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,235 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:55:47,235 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:47,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:47,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:47,235 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:55:47,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:47,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:47,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:47,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:47,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:55:47,237 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:55:47,237 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:47,237 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:47,237 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,237 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:47,238 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,238 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,239 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:47,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,239 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:47,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:47,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,240 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:47,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,242 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:47,242 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,243 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:47,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:47,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:47,242 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:47,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:47,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:47,243 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:55:47,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:47,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:47,243 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:47,243 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,243 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:47,243 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,243 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,243 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,243 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,343 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:47,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:47,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:47,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:47,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,349 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:47,349 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:47,350 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:55:47,350 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:55:47,350 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,350 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,352 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:47,352 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:47,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:47,352 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:47,352 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:47,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:47,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,353 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,353 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:55:47,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:47,353 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:55:47,353 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:47,353 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:55:47,353 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:55:47,353 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:47,353 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:47,353 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. started... 2023-10-30 21:55:47,354 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059490245c09fc93a3f34853d7b38366 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:55:47,768 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512287a629720c8814ae4832ed6e6152fead3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512287a629720c8814ae4832ed6e6152fead3 2023-10-30 21:55:48,173 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/d3309651b8c244ccb59ac4469e8457d6 2023-10-30 21:55:48,177 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/d3309651b8c244ccb59ac4469e8457d6 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d3309651b8c244ccb59ac4469e8457d6 2023-10-30 21:55:48,181 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d3309651b8c244ccb59ac4469e8457d6, entries=1, sequenceid=21, filesize=4.9 K 2023-10-30 21:55:48,181 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059490245c09fc93a3f34853d7b38366 in 827ms, sequenceid=21, compaction requested=true 2023-10-30 21:55:48,182 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:48,182 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:48,182 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:55:48,182 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:55:48,182 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,182 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:55:48,182 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:55:48,184 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,184 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:48,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:48,184 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,185 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:48,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:48,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:48,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:48,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:55:48,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7eb22e85[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:48,186 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:55:48,186 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,187 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,187 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:55:48,187 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:55:48,187 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:48,187 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,187 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:48,188 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:55:48,188 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,188 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:48,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,188 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:55:48,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:48,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:48,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:55:48,191 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:55:48,191 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:48,191 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:48,191 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,191 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:48,193 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,193 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,193 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:48,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,193 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:48,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,195 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,199 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,199 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:48,199 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,199 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:48,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:48,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:55:48,199 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:48,199 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:48,199 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:48,199 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:48,199 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,199 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,199 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:48,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:48,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:48,200 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:48,300 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:48,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:48,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:48,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:48,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,306 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:48,306 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:48,306 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:55:48,306 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:55:48,306 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,306 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,308 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:48,308 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:48,308 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:48,308 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,309 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,309 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:55:48,309 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:48,309 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:55:48,309 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:48,309 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:55:48,309 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:55:48,309 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:48,309 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:48,309 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. started... 2023-10-30 21:55:48,309 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059490245c09fc93a3f34853d7b38366 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:55:48,720 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231805906ca22fc47e5b192fb5528bea5bd to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231805906ca22fc47e5b192fb5528bea5bd 2023-10-30 21:55:48,858 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:55:49,125 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/979902f2f5e14813b167a0ac4ec81391 2023-10-30 21:55:49,129 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/979902f2f5e14813b167a0ac4ec81391 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/979902f2f5e14813b167a0ac4ec81391 2023-10-30 21:55:49,133 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/979902f2f5e14813b167a0ac4ec81391, entries=1, sequenceid=25, filesize=4.9 K 2023-10-30 21:55:49,133 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059490245c09fc93a3f34853d7b38366 in 824ms, sequenceid=25, compaction requested=true 2023-10-30 21:55:49,133 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:49,133 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:49,134 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:55:49,134 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:55:49,134 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,134 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:55:49,134 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:55:49,135 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,135 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:49,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:49,135 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,135 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:49,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:55:49,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3458ecd8[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:49,137 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:55:49,137 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,139 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:55:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:55:49,139 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:49,139 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,139 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:49,140 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:55:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:49,141 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,141 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:55:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:49,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:49,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:55:49,143 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:55:49,143 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:49,143 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:49,143 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,143 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:49,144 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,144 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:49,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,145 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:49,145 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:49,146 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:49,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,148 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,148 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,148 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:49,148 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,148 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:49,148 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:49,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:49,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:49,148 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:49,148 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:49,148 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,148 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,148 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:49,149 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:49,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:55:49,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:49,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:49,249 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:49,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:49,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:49,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:49,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,255 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:49,255 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:49,255 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:55:49,255 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:55:49,255 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,255 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,257 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:49,257 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:49,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:49,258 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,258 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:49,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,258 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,259 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:55:49,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,259 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:55:49,259 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:49,259 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:55:49,259 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:55:49,259 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:49,259 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:49,259 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. started... 2023-10-30 21:55:49,259 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059490245c09fc93a3f34853d7b38366 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:55:49,268 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c4a5e739acc947e7bc65d567a1b810e8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101c4a5e739acc947e7bc65d567a1b810e8 2023-10-30 21:55:49,673 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/9b301d4ffdac4939be1b9c37c4b20fb4 2023-10-30 21:55:49,677 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/9b301d4ffdac4939be1b9c37c4b20fb4 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9b301d4ffdac4939be1b9c37c4b20fb4 2023-10-30 21:55:49,680 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9b301d4ffdac4939be1b9c37c4b20fb4, entries=1, sequenceid=29, filesize=4.9 K 2023-10-30 21:55:49,681 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059490245c09fc93a3f34853d7b38366 in 422ms, sequenceid=29, compaction requested=true 2023-10-30 21:55:49,681 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:49,681 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:49,681 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:55:49,681 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:55:49,681 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,681 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:55:49,681 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:55:49,683 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,683 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:49,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:49,683 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,683 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:49,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:49,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:49,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:55:49,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5371e6d0[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:49,684 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:55:49,685 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,686 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,686 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:55:49,686 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,686 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:49,686 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:55:49,686 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:49,687 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,687 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:55:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:49,687 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:49,687 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:55:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:49,689 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:55:49,689 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:55:49,690 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:49,690 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:49,690 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,690 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:49,692 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,692 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:49,692 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:49,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:49,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,692 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:49,693 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:49,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,695 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,696 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,696 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,696 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,696 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,696 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:49,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:49,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:49,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:49,696 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:49,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:55:49,696 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:49,696 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,696 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:49,696 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:49,696 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:49,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:49,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:49,796 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:49,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:49,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:49,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:49,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,803 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:49,803 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:49,803 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:55:49,803 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:55:49,803 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,803 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,805 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,805 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:49,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:49,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:49,805 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:49,805 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:49,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,805 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,806 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,806 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:55:49,806 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:49,806 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:55:49,806 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:49,806 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:55:49,806 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:55:49,806 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:49,806 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:49,807 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. started... 2023-10-30 21:55:49,807 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059490245c09fc93a3f34853d7b38366 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:55:50,218 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103db79b723364245beaff5143af6bc30b3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103db79b723364245beaff5143af6bc30b3 2023-10-30 21:55:50,623 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/835d6ddd30634fae8b9052695200c4a2 2023-10-30 21:55:50,627 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/835d6ddd30634fae8b9052695200c4a2 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/835d6ddd30634fae8b9052695200c4a2 2023-10-30 21:55:50,630 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/835d6ddd30634fae8b9052695200c4a2, entries=1, sequenceid=33, filesize=4.9 K 2023-10-30 21:55:50,631 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059490245c09fc93a3f34853d7b38366 in 824ms, sequenceid=33, compaction requested=true 2023-10-30 21:55:50,631 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:50,631 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:50,632 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:55:50,632 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:55:50,632 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,632 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:55:50,632 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:55:50,633 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,633 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:50,634 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,634 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:50,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:55:50,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21ee8dab[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:50,635 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:55:50,635 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,636 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,636 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:55:50,636 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,636 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:50,636 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:55:50,637 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:50,638 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,638 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:55:50,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:50,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:50,638 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:50,638 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:55:50,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:50,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:50,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:55:50,640 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:55:50,640 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:50,640 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:50,640 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,640 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:50,647 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,647 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:50,647 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,648 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:50,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:50,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,649 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:50,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,651 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,651 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:50,651 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,651 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:50,651 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:50,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:50,651 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:50,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-30 21:55:50,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:50,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:50,651 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,651 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,651 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:50,651 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,652 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:50,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:50,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:50,652 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,752 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:50,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:50,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:50,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:50,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,758 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:50,758 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:50,759 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:55:50,759 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:55:50,759 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,759 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,760 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:50,760 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:50,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:50,761 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:50,761 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:50,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:50,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,762 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,762 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:55:50,762 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:50,762 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:55:50,762 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:50,762 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:55:50,762 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:55:50,762 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:50,762 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:50,762 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. started... 2023-10-30 21:55:50,762 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059490245c09fc93a3f34853d7b38366 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:55:51,174 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090783db1e320fc345cd9f87eb9712eba4f2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090783db1e320fc345cd9f87eb9712eba4f2 2023-10-30 21:55:51,579 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/d7ad13beba614b4fb4b7de07e6cc55a9 2023-10-30 21:55:51,583 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/d7ad13beba614b4fb4b7de07e6cc55a9 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d7ad13beba614b4fb4b7de07e6cc55a9 2023-10-30 21:55:51,586 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d7ad13beba614b4fb4b7de07e6cc55a9, entries=1, sequenceid=37, filesize=4.9 K 2023-10-30 21:55:51,587 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059490245c09fc93a3f34853d7b38366 in 825ms, sequenceid=37, compaction requested=true 2023-10-30 21:55:51,587 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:51,587 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:51,587 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:55:51,587 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:55:51,587 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,587 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:55:51,587 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:55:51,589 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,589 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:51,589 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,589 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:51,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:51,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:55:51,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ec74915[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:51,591 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:55:51,591 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,593 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,593 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:55:51,593 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:55:51,593 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,593 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:51,593 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:51,595 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,595 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:55:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:51,595 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:51,595 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:55:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:51,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:51,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:55:51,597 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:55:51,597 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:51,597 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:51,597 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,597 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:51,599 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,599 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:51,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,599 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,599 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:51,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:51,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,600 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,602 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,602 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,602 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:51,602 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:51,602 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:51,603 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:51,603 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:51,603 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:51,603 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,603 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:51,603 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:51,603 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:51,703 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:51,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:51,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:51,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:51,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,709 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:51,709 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:51,709 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-30 21:55:51,709 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-30 21:55:51,710 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,711 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,713 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:51,713 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:51,714 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:51,714 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:51,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:51,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,714 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,715 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-30 21:55:51,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:51,715 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-30 21:55:51,715 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:51,715 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-30 21:55:51,715 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-30 21:55:51,715 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:51,715 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:51,715 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. started... 2023-10-30 21:55:51,715 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 059490245c09fc93a3f34853d7b38366 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-30 21:55:52,129 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208f7d7c79820344ca8d602c84ef67c38a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511208f7d7c79820344ca8d602c84ef67c38a 2023-10-30 21:55:52,134 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/06bb0fb26cb94d50b93231cc7c99b204 2023-10-30 21:55:52,138 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/06bb0fb26cb94d50b93231cc7c99b204 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/06bb0fb26cb94d50b93231cc7c99b204 2023-10-30 21:55:52,141 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/06bb0fb26cb94d50b93231cc7c99b204, entries=1, sequenceid=41, filesize=4.9 K 2023-10-30 21:55:52,142 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 059490245c09fc93a3f34853d7b38366 in 427ms, sequenceid=41, compaction requested=true 2023-10-30 21:55:52,142 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:52,142 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:52,142 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-30 21:55:52,142 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-30 21:55:52,142 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,142 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-30 21:55:52,142 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-30 21:55:52,143 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,143 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:52,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:52,144 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:52,144 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:52,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:52,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:52,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-30 21:55:52,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d8a4239[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:52,145 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-30 21:55:52,145 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,146 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,146 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-30 21:55:52,146 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-30 21:55:52,146 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:52,147 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,147 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:52,148 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-30 21:55:52,148 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,148 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:52,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:52,148 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-30 21:55:52,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:52,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:52,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:52,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-30 21:55:52,150 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-30 21:55:52,150 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:52,150 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:52,150 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,150 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:52,153 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,153 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:52,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:52,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,153 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:52,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:52,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:52,153 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:52,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:52,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,154 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:52,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,156 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,156 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,156 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,156 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:52,156 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:52,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-30 21:55:52,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:52,156 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:52,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:52,156 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:52,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:52,156 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,157 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,157 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:52,157 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:52,157 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:52,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:52,257 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:52,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:52,259 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-10-30 21:55:52,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:55:52,261 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:55:52,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:55:52,262 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703552262 2023-10-30 21:55:52,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-30 21:55:52,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-30 21:55:52,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:55:52,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x7c4c3b09 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:55:52,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@be2e8b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:55:52,269 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:55:53,092 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010353c2187415ed45e2b5eeaeb210ee1b72 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010353c2187415ed45e2b5eeaeb210ee1b72 2023-10-30 21:55:53,094 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:55:53,106 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:55:53,108 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:55:53,115 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:55:53,116 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:55:53,128 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/08209a6532834ec9be042ca6cd825f38 first=Optional[r5] last=Optional[r6] 2023-10-30 21:55:53,129 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/08209a6532834ec9be042ca6cd825f38}] 2023-10-30 21:55:53,137 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/08209a6532834ec9be042ca6cd825f38 for inclusion in 059490245c09fc93a3f34853d7b38366/family1 2023-10-30 21:55:53,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-30 21:55:53,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:55:53,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:53,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/08209a6532834ec9be042ca6cd825f38 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lff3bdjjkue6md7uvg23822qb2enbouomb2luceiqi91vprh66fnftr3obq7ovkj/family1/08209a6532834ec9be042ca6cd825f38 2023-10-30 21:55:53,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lff3bdjjkue6md7uvg23822qb2enbouomb2luceiqi91vprh66fnftr3obq7ovkj/family1/08209a6532834ec9be042ca6cd825f38 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/6022875019fe443894fbce4168af8865_SeqId_44_ 2023-10-30 21:55:53,143 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lff3bdjjkue6md7uvg23822qb2enbouomb2luceiqi91vprh66fnftr3obq7ovkj/family1/08209a6532834ec9be042ca6cd825f38 into 059490245c09fc93a3f34853d7b38366/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/6022875019fe443894fbce4168af8865_SeqId_44_ - updating store file list. 2023-10-30 21:55:53,147 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/6022875019fe443894fbce4168af8865_SeqId_44_ into 059490245c09fc93a3f34853d7b38366/family1 2023-10-30 21:55:53,147 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lff3bdjjkue6md7uvg23822qb2enbouomb2luceiqi91vprh66fnftr3obq7ovkj/family1/08209a6532834ec9be042ca6cd825f38 into 059490245c09fc93a3f34853d7b38366/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/6022875019fe443894fbce4168af8865_SeqId_44_) 2023-10-30 21:55:53,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lff3bdjjkue6md7uvg23822qb2enbouomb2luceiqi91vprh66fnftr3obq7ovkj/family1/08209a6532834ec9be042ca6cd825f38 2023-10-30 21:55:53,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-30 21:55:53,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-30 21:55:53,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(1912): 059490245c09fc93a3f34853d7b38366/family1 is initiating minor compaction 2023-10-30 21:55:53,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5cd3c74c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:55:53,150 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 059490245c09fc93a3f34853d7b38366/family1 in testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:53,150 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/ac1678deb1df4ad088e2b5b33b6e52fd, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/2af1af46b50f423dba9e44e04cf18db1, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/bf8fdfa5b5884e9994810e0c1e8433af, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d3309651b8c244ccb59ac4469e8457d6, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/979902f2f5e14813b167a0ac4ec81391, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9b301d4ffdac4939be1b9c37c4b20fb4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/835d6ddd30634fae8b9052695200c4a2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d7ad13beba614b4fb4b7de07e6cc55a9, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/06bb0fb26cb94d50b93231cc7c99b204, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/6022875019fe443894fbce4168af8865_SeqId_44_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp, totalSize=49.7 K 2023-10-30 21:55:53,150 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting ac1678deb1df4ad088e2b5b33b6e52fd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-30 21:55:53,150 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 2af1af46b50f423dba9e44e04cf18db1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-30 21:55:53,150 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting bf8fdfa5b5884e9994810e0c1e8433af, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-30 21:55:53,150 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting d3309651b8c244ccb59ac4469e8457d6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-30 21:55:53,150 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 979902f2f5e14813b167a0ac4ec81391, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-30 21:55:53,151 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 9b301d4ffdac4939be1b9c37c4b20fb4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-30 21:55:53,151 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 835d6ddd30634fae8b9052695200c4a2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-30 21:55:53,151 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting d7ad13beba614b4fb4b7de07e6cc55a9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-30 21:55:53,151 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 06bb0fb26cb94d50b93231cc7c99b204, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-30 21:55:53,151 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 6022875019fe443894fbce4168af8865_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-30 21:55:53,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:55:53,165 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:53,167 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101c4a5e739acc947e7bc65d567a1b810e8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101c4a5e739acc947e7bc65d567a1b810e8 2023-10-30 21:55:53,170 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103db79b723364245beaff5143af6bc30b3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103db79b723364245beaff5143af6bc30b3 2023-10-30 21:55:53,170 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-30 21:55:53,170 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-30 21:55:53,171 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:55:53,171 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:55:53,205 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 059490245c09fc93a3f34853d7b38366#family1#compaction#166 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:53,631 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231eafddacd9c074147a0a5f3c04160356f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231eafddacd9c074147a0a5f3c04160356f 2023-10-30 21:55:53,632 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:55:53,654 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/09a3ed82370948fe888cca8fe8fdd3ef first=Optional[r1] last=Optional[r4] 2023-10-30 21:55:53,654 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/09a3ed82370948fe888cca8fe8fdd3ef}] 2023-10-30 21:55:53,656 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/09a3ed82370948fe888cca8fe8fdd3ef for inclusion in 059490245c09fc93a3f34853d7b38366/family1 2023-10-30 21:55:53,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-30 21:55:53,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:55:53,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:53,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/09a3ed82370948fe888cca8fe8fdd3ef to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2kppkkqk403ht98670osrsu500eu70gr9reh7vcs2vg2huqtustjj5j58escifrr/family1/09a3ed82370948fe888cca8fe8fdd3ef 2023-10-30 21:55:53,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2kppkkqk403ht98670osrsu500eu70gr9reh7vcs2vg2huqtustjj5j58escifrr/family1/09a3ed82370948fe888cca8fe8fdd3ef as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9672b98a8a9b4031b0567752919dbcc2_SeqId_46_ 2023-10-30 21:55:53,661 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2kppkkqk403ht98670osrsu500eu70gr9reh7vcs2vg2huqtustjj5j58escifrr/family1/09a3ed82370948fe888cca8fe8fdd3ef into 059490245c09fc93a3f34853d7b38366/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9672b98a8a9b4031b0567752919dbcc2_SeqId_46_ - updating store file list. 2023-10-30 21:55:53,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9672b98a8a9b4031b0567752919dbcc2_SeqId_46_ into 059490245c09fc93a3f34853d7b38366/family1 2023-10-30 21:55:53,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2kppkkqk403ht98670osrsu500eu70gr9reh7vcs2vg2huqtustjj5j58escifrr/family1/09a3ed82370948fe888cca8fe8fdd3ef into 059490245c09fc93a3f34853d7b38366/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9672b98a8a9b4031b0567752919dbcc2_SeqId_46_) 2023-10-30 21:55:53,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2kppkkqk403ht98670osrsu500eu70gr9reh7vcs2vg2huqtustjj5j58escifrr/family1/09a3ed82370948fe888cca8fe8fdd3ef 2023-10-30 21:55:53,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:55:53,667 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:53,669 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512018e0cd41ac4914eff980601ffd0d465bd to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512018e0cd41ac4914eff980601ffd0d465bd 2023-10-30 21:55:53,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205da47a3ce7e5549c4bd22908f79341839 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205da47a3ce7e5549c4bd22908f79341839 2023-10-30 21:55:53,671 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512287a629720c8814ae4832ed6e6152fead3 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512287a629720c8814ae4832ed6e6152fead3 2023-10-30 21:55:53,672 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231805906ca22fc47e5b192fb5528bea5bd to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231805906ca22fc47e5b192fb5528bea5bd 2023-10-30 21:55:53,673 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-30 21:55:53,673 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-30 21:55:53,673 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:55:53,673 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:55:54,021 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/8631d3bb0a0e4cb790d80a5ef6f093bb as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/8631d3bb0a0e4cb790d80a5ef6f093bb 2023-10-30 21:55:54,025 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 059490245c09fc93a3f34853d7b38366/family1 of 059490245c09fc93a3f34853d7b38366 into 8631d3bb0a0e4cb790d80a5ef6f093bb(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:55:54,025 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:54,025 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698702953150; duration=0sec 2023-10-30 21:55:54,025 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:55:54,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/ac1678deb1df4ad088e2b5b33b6e52fd, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/2af1af46b50f423dba9e44e04cf18db1, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/bf8fdfa5b5884e9994810e0c1e8433af, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d3309651b8c244ccb59ac4469e8457d6, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/979902f2f5e14813b167a0ac4ec81391, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9b301d4ffdac4939be1b9c37c4b20fb4, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/835d6ddd30634fae8b9052695200c4a2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d7ad13beba614b4fb4b7de07e6cc55a9, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/06bb0fb26cb94d50b93231cc7c99b204, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/6022875019fe443894fbce4168af8865_SeqId_44_] to archive 2023-10-30 21:55:54,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:54,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/ac1678deb1df4ad088e2b5b33b6e52fd to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/ac1678deb1df4ad088e2b5b33b6e52fd 2023-10-30 21:55:54,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/2af1af46b50f423dba9e44e04cf18db1 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/2af1af46b50f423dba9e44e04cf18db1 2023-10-30 21:55:54,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/bf8fdfa5b5884e9994810e0c1e8433af to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/bf8fdfa5b5884e9994810e0c1e8433af 2023-10-30 21:55:54,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d3309651b8c244ccb59ac4469e8457d6 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d3309651b8c244ccb59ac4469e8457d6 2023-10-30 21:55:54,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/979902f2f5e14813b167a0ac4ec81391 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/979902f2f5e14813b167a0ac4ec81391 2023-10-30 21:55:54,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9b301d4ffdac4939be1b9c37c4b20fb4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9b301d4ffdac4939be1b9c37c4b20fb4 2023-10-30 21:55:54,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/835d6ddd30634fae8b9052695200c4a2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/835d6ddd30634fae8b9052695200c4a2 2023-10-30 21:55:54,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d7ad13beba614b4fb4b7de07e6cc55a9 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/d7ad13beba614b4fb4b7de07e6cc55a9 2023-10-30 21:55:54,114 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/06bb0fb26cb94d50b93231cc7c99b204 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/06bb0fb26cb94d50b93231cc7c99b204 2023-10-30 21:55:54,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/6022875019fe443894fbce4168af8865_SeqId_44_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/6022875019fe443894fbce4168af8865_SeqId_44_ 2023-10-30 21:55:54,510 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304c783e433a3e483588743f81fa2aefa8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511304c783e433a3e483588743f81fa2aefa8 2023-10-30 21:55:54,510 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:55:54,540 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7e163686cc7c48f3984a511544091f04 first=Optional[r00] last=Optional[r8] 2023-10-30 21:55:54,541 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7e163686cc7c48f3984a511544091f04}] 2023-10-30 21:55:54,542 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7e163686cc7c48f3984a511544091f04 for inclusion in 059490245c09fc93a3f34853d7b38366/family1 2023-10-30 21:55:54,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-30 21:55:54,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last= 2023-10-30 21:55:54,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:54,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7e163686cc7c48f3984a511544091f04 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jetfv0gptogl1u6plasgk7g34gbvrk2gfc5lo9ehlvapkmf3u06h9gnkia4sbgsk/family1/7e163686cc7c48f3984a511544091f04 2023-10-30 21:55:54,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jetfv0gptogl1u6plasgk7g34gbvrk2gfc5lo9ehlvapkmf3u06h9gnkia4sbgsk/family1/7e163686cc7c48f3984a511544091f04 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/e93dd43e34ec41ab889f539ad1d3c28f_SeqId_49_ 2023-10-30 21:55:54,548 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jetfv0gptogl1u6plasgk7g34gbvrk2gfc5lo9ehlvapkmf3u06h9gnkia4sbgsk/family1/7e163686cc7c48f3984a511544091f04 into 059490245c09fc93a3f34853d7b38366/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/e93dd43e34ec41ab889f539ad1d3c28f_SeqId_49_ - updating store file list. 2023-10-30 21:55:54,551 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/e93dd43e34ec41ab889f539ad1d3c28f_SeqId_49_ into 059490245c09fc93a3f34853d7b38366/family1 2023-10-30 21:55:54,551 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jetfv0gptogl1u6plasgk7g34gbvrk2gfc5lo9ehlvapkmf3u06h9gnkia4sbgsk/family1/7e163686cc7c48f3984a511544091f04 into 059490245c09fc93a3f34853d7b38366/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/e93dd43e34ec41ab889f539ad1d3c28f_SeqId_49_) 2023-10-30 21:55:54,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jetfv0gptogl1u6plasgk7g34gbvrk2gfc5lo9ehlvapkmf3u06h9gnkia4sbgsk/family1/7e163686cc7c48f3984a511544091f04 2023-10-30 21:55:54,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-30 21:55:54,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-30 21:55:54,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(1912): 059490245c09fc93a3f34853d7b38366/family1 is initiating minor compaction (all files) 2023-10-30 21:55:54,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@454582ae; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:55:54,553 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 059490245c09fc93a3f34853d7b38366/family1 in testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:55:54,553 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/dff13b5c373d4034ba93893ec848f45c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/8631d3bb0a0e4cb790d80a5ef6f093bb, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9672b98a8a9b4031b0567752919dbcc2_SeqId_46_, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/e93dd43e34ec41ab889f539ad1d3c28f_SeqId_49_] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp, totalSize=344.3 K 2023-10-30 21:55:54,554 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting dff13b5c373d4034ba93893ec848f45c, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878822322 2023-10-30 21:55:54,554 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 8631d3bb0a0e4cb790d80a5ef6f093bb, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621222322 2023-10-30 21:55:54,555 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting 9672b98a8a9b4031b0567752919dbcc2_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965222322 2023-10-30 21:55:54,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:55:54,555 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] compactions.Compactor(207): Compacting e93dd43e34ec41ab889f539ad1d3c28f_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014822322 2023-10-30 21:55:54,555 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:54,557 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511208f7d7c79820344ca8d602c84ef67c38a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511208f7d7c79820344ca8d602c84ef67c38a 2023-10-30 21:55:54,558 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511287964a80bc08a447aa8cd6128ec8dbf94 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511287964a80bc08a447aa8cd6128ec8dbf94 2023-10-30 21:55:54,559 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511307403f520e3154796bce7b35514dcad7d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511307403f520e3154796bce7b35514dcad7d 2023-10-30 21:55:54,559 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-30 21:55:54,559 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-30 21:55:54,559 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:55:54,559 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:55:54,559 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-30 21:55:54,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-30 21:55:54,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:55:54,561 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-30 21:55:54,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.3010 sec 2023-10-30 21:55:54,571 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] throttle.PressureAwareThroughputController(145): 059490245c09fc93a3f34853d7b38366#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:55:54,782 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=259 (was 256) - Thread LEAK? -, OpenFileDescriptor=641 (was 652), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=237 (was 257), ProcessCount=167 (was 167), AvailableMemoryMB=15182 (was 15176) - AvailableMemoryMB LEAK? - 2023-10-30 21:55:54,796 INFO [Listener at localhost/36139] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=259, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=237, ProcessCount=167, AvailableMemoryMB=15181 2023-10-30 21:55:54,815 DEBUG [Listener at localhost/36139] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-10-30 21:55:54,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xD1\x0A\xDCy\x8E\xEB\xBA\x17\xF0\xF9@\xF9:J\xA6"\x10\xF4\xC2KIyLCC\xBD\xED\xD5i\x1A\xA5\xA3\xE7*\x10\x8C(\x99\xFEM\x12~\xD1\xF2\xEC~*\x1C0\xE6\xFB2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-30 21:55:54,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-10-30 21:55:54,871 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-10-30 21:55:54,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-10-30 21:55:54,872 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-30 21:55:54,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 21:55:54,874 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:55:54,874 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:55:54,874 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440 2023-10-30 21:55:54,874 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710 empty. 2023-10-30 21:55:54,874 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440 empty. 2023-10-30 21:55:54,874 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02 empty. 2023-10-30 21:55:54,875 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:55:54,875 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440 2023-10-30 21:55:54,875 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:55:54,875 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-10-30 21:55:54,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 21:55:55,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 21:55:55,282 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-10-30 21:55:55,283 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => b644f44aa9cca8a1270c4b1b821da710, NAME => 'testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xD1\x0A\xDCy\x8E\xEB\xBA\x17\xF0\xF9@\xF9:J\xA6"\x10\xF4\xC2KIyLCC\xBD\xED\xD5i\x1A\xA5\xA3\xE7*\x10\x8C(\x99\xFEM\x12~\xD1\xF2\xEC~*\x1C0\xE6\xFB2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:55:55,283 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 07ec08f87a490626e406acf5870c9440, NAME => 'testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xD1\x0A\xDCy\x8E\xEB\xBA\x17\xF0\xF9@\xF9:J\xA6"\x10\xF4\xC2KIyLCC\xBD\xED\xD5i\x1A\xA5\xA3\xE7*\x10\x8C(\x99\xFEM\x12~\xD1\xF2\xEC~*\x1C0\xE6\xFB2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:55:55,283 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 38f4a1d5f9397e7a0d35170398eebc02, NAME => 'testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xD1\x0A\xDCy\x8E\xEB\xBA\x17\xF0\xF9@\xF9:J\xA6"\x10\xF4\xC2KIyLCC\xBD\xED\xD5i\x1A\xA5\xA3\xE7*\x10\x8C(\x99\xFEM\x12~\xD1\xF2\xEC~*\x1C0\xE6\xFB2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/.tmp 2023-10-30 21:55:55,296 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:55,296 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing b644f44aa9cca8a1270c4b1b821da710, disabling compactions & flushes 2023-10-30 21:55:55,296 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:55,296 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:55,296 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. after waiting 0 ms 2023-10-30 21:55:55,296 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:55,296 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:55,296 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:55:55,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 21:55:55,697 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:55,697 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 07ec08f87a490626e406acf5870c9440, disabling compactions & flushes 2023-10-30 21:55:55,697 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:55,697 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:55,697 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. after waiting 0 ms 2023-10-30 21:55:55,697 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:55,697 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:55,697 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:55:55,698 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:55,698 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 38f4a1d5f9397e7a0d35170398eebc02, disabling compactions & flushes 2023-10-30 21:55:55,698 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:55:55,698 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:55:55,698 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. after waiting 0 ms 2023-10-30 21:55:55,698 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:55:55,699 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:55:55,699 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:55:55,701 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-10-30 21:55:55,702 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702955702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702955702"}]},"ts":"1698702955702"} 2023-10-30 21:55:55,702 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702955702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702955702"}]},"ts":"1698702955702"} 2023-10-30 21:55:55,702 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698702955702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698702955702"}]},"ts":"1698702955702"} 2023-10-30 21:55:55,704 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-30 21:55:55,704 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-30 21:55:55,705 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702955705"}]},"ts":"1698702955705"} 2023-10-30 21:55:55,706 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-10-30 21:55:55,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b644f44aa9cca8a1270c4b1b821da710, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38f4a1d5f9397e7a0d35170398eebc02, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=07ec08f87a490626e406acf5870c9440, ASSIGN}] 2023-10-30 21:55:55,710 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38f4a1d5f9397e7a0d35170398eebc02, ASSIGN 2023-10-30 21:55:55,710 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b644f44aa9cca8a1270c4b1b821da710, ASSIGN 2023-10-30 21:55:55,711 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=07ec08f87a490626e406acf5870c9440, ASSIGN 2023-10-30 21:55:55,711 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38f4a1d5f9397e7a0d35170398eebc02, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:55:55,711 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b644f44aa9cca8a1270c4b1b821da710, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:55:55,711 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=07ec08f87a490626e406acf5870c9440, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44371,1698702798019; forceNewPlan=false, retain=false 2023-10-30 21:55:55,790 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/.tmp/family1/fc0c55beb2fe4b6f873a505c7db26c19 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/fc0c55beb2fe4b6f873a505c7db26c19 2023-10-30 21:55:55,794 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 059490245c09fc93a3f34853d7b38366/family1 of 059490245c09fc93a3f34853d7b38366 into fc0c55beb2fe4b6f873a505c7db26c19(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:55:55,795 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:55:55,795 INFO [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1698702954553; duration=1sec 2023-10-30 21:55:55,795 DEBUG [RS:0;jenkins-hbase4:44371-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-30 21:55:55,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/dff13b5c373d4034ba93893ec848f45c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/8631d3bb0a0e4cb790d80a5ef6f093bb, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9672b98a8a9b4031b0567752919dbcc2_SeqId_46_, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/e93dd43e34ec41ab889f539ad1d3c28f_SeqId_49_] to archive 2023-10-30 21:55:55,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:55:55,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/dff13b5c373d4034ba93893ec848f45c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/dff13b5c373d4034ba93893ec848f45c 2023-10-30 21:55:55,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/8631d3bb0a0e4cb790d80a5ef6f093bb to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/8631d3bb0a0e4cb790d80a5ef6f093bb 2023-10-30 21:55:55,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9672b98a8a9b4031b0567752919dbcc2_SeqId_46_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/9672b98a8a9b4031b0567752919dbcc2_SeqId_46_ 2023-10-30 21:55:55,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/e93dd43e34ec41ab889f539ad1d3c28f_SeqId_49_ to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/family1/e93dd43e34ec41ab889f539ad1d3c28f_SeqId_49_ 2023-10-30 21:55:55,863 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=b644f44aa9cca8a1270c4b1b821da710, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:55,863 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=07ec08f87a490626e406acf5870c9440, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:55,863 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=38f4a1d5f9397e7a0d35170398eebc02, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:55,864 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702955863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702955863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702955863"}]},"ts":"1698702955863"} 2023-10-30 21:55:55,864 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702955863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702955863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702955863"}]},"ts":"1698702955863"} 2023-10-30 21:55:55,864 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698702955863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1698702955863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698702955863"}]},"ts":"1698702955863"} 2023-10-30 21:55:55,865 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure b644f44aa9cca8a1270c4b1b821da710, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:55,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 07ec08f87a490626e406acf5870c9440, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:55,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 38f4a1d5f9397e7a0d35170398eebc02, server=jenkins-hbase4.apache.org,44371,1698702798019}] 2023-10-30 21:55:55,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 21:55:56,017 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:56,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:56,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b644f44aa9cca8a1270c4b1b821da710, NAME => 'testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710.', STARTKEY => '', ENDKEY => '1'} 2023-10-30 21:55:56,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:55:56,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:56,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:55:56,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:55:56,043 INFO [StoreOpener-b644f44aa9cca8a1270c4b1b821da710-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:55:56,044 DEBUG [StoreOpener-b644f44aa9cca8a1270c4b1b821da710-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1 2023-10-30 21:55:56,044 DEBUG [StoreOpener-b644f44aa9cca8a1270c4b1b821da710-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1 2023-10-30 21:55:56,044 INFO [StoreOpener-b644f44aa9cca8a1270c4b1b821da710-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b644f44aa9cca8a1270c4b1b821da710 columnFamilyName family1 2023-10-30 21:55:56,045 INFO [StoreOpener-b644f44aa9cca8a1270c4b1b821da710-1] regionserver.HStore(310): Store=b644f44aa9cca8a1270c4b1b821da710/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:56,046 INFO [StoreOpener-b644f44aa9cca8a1270c4b1b821da710-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:55:56,047 DEBUG [StoreOpener-b644f44aa9cca8a1270c4b1b821da710-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2 2023-10-30 21:55:56,047 DEBUG [StoreOpener-b644f44aa9cca8a1270c4b1b821da710-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2 2023-10-30 21:55:56,047 INFO [StoreOpener-b644f44aa9cca8a1270c4b1b821da710-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b644f44aa9cca8a1270c4b1b821da710 columnFamilyName family2 2023-10-30 21:55:56,048 INFO [StoreOpener-b644f44aa9cca8a1270c4b1b821da710-1] regionserver.HStore(310): Store=b644f44aa9cca8a1270c4b1b821da710/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:56,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:55:56,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:55:56,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:55:56,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:55:56,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:55:56,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b644f44aa9cca8a1270c4b1b821da710; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66944389, jitterRate=-0.0024508684873580933}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:55:56,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:55:56,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710., pid=120, masterSystemTime=1698702956017 2023-10-30 21:55:56,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:56,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:56,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:56,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 07ec08f87a490626e406acf5870c9440, NAME => 'testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440.', STARTKEY => '2', ENDKEY => ''} 2023-10-30 21:55:56,055 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=b644f44aa9cca8a1270c4b1b821da710, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:56,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 07ec08f87a490626e406acf5870c9440 2023-10-30 21:55:56,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:56,055 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702956055"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702956055"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702956055"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702956055"}]},"ts":"1698702956055"} 2023-10-30 21:55:56,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 07ec08f87a490626e406acf5870c9440 2023-10-30 21:55:56,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 07ec08f87a490626e406acf5870c9440 2023-10-30 21:55:56,058 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=117 2023-10-30 21:55:56,058 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure b644f44aa9cca8a1270c4b1b821da710, server=jenkins-hbase4.apache.org,44371,1698702798019 in 191 msec 2023-10-30 21:55:56,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b644f44aa9cca8a1270c4b1b821da710, ASSIGN in 350 msec 2023-10-30 21:55:56,075 INFO [StoreOpener-07ec08f87a490626e406acf5870c9440-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 07ec08f87a490626e406acf5870c9440 2023-10-30 21:55:56,076 DEBUG [StoreOpener-07ec08f87a490626e406acf5870c9440-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1 2023-10-30 21:55:56,077 DEBUG [StoreOpener-07ec08f87a490626e406acf5870c9440-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1 2023-10-30 21:55:56,077 INFO [StoreOpener-07ec08f87a490626e406acf5870c9440-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07ec08f87a490626e406acf5870c9440 columnFamilyName family1 2023-10-30 21:55:56,078 INFO [StoreOpener-07ec08f87a490626e406acf5870c9440-1] regionserver.HStore(310): Store=07ec08f87a490626e406acf5870c9440/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:56,078 INFO [StoreOpener-07ec08f87a490626e406acf5870c9440-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 07ec08f87a490626e406acf5870c9440 2023-10-30 21:55:56,079 DEBUG [StoreOpener-07ec08f87a490626e406acf5870c9440-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2 2023-10-30 21:55:56,079 DEBUG [StoreOpener-07ec08f87a490626e406acf5870c9440-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2 2023-10-30 21:55:56,079 INFO [StoreOpener-07ec08f87a490626e406acf5870c9440-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 07ec08f87a490626e406acf5870c9440 columnFamilyName family2 2023-10-30 21:55:56,080 INFO [StoreOpener-07ec08f87a490626e406acf5870c9440-1] regionserver.HStore(310): Store=07ec08f87a490626e406acf5870c9440/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:56,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440 2023-10-30 21:55:56,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440 2023-10-30 21:55:56,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:55:56,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 07ec08f87a490626e406acf5870c9440 2023-10-30 21:55:56,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:55:56,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 07ec08f87a490626e406acf5870c9440; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66521123, jitterRate=-0.008758023381233215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:55:56,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:55:56,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440., pid=121, masterSystemTime=1698702956017 2023-10-30 21:55:56,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:56,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:56,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:55:56,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 38f4a1d5f9397e7a0d35170398eebc02, NAME => 'testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02.', STARTKEY => '1', ENDKEY => '2'} 2023-10-30 21:55:56,086 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=07ec08f87a490626e406acf5870c9440, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:56,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:55:56,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-30 21:55:56,087 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698702956086"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702956086"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702956086"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702956086"}]},"ts":"1698702956086"} 2023-10-30 21:55:56,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:55:56,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:55:56,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=119 2023-10-30 21:55:56,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 07ec08f87a490626e406acf5870c9440, server=jenkins-hbase4.apache.org,44371,1698702798019 in 222 msec 2023-10-30 21:55:56,090 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=07ec08f87a490626e406acf5870c9440, ASSIGN in 381 msec 2023-10-30 21:55:56,108 INFO [StoreOpener-38f4a1d5f9397e7a0d35170398eebc02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:55:56,109 DEBUG [StoreOpener-38f4a1d5f9397e7a0d35170398eebc02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1 2023-10-30 21:55:56,109 DEBUG [StoreOpener-38f4a1d5f9397e7a0d35170398eebc02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1 2023-10-30 21:55:56,109 INFO [StoreOpener-38f4a1d5f9397e7a0d35170398eebc02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38f4a1d5f9397e7a0d35170398eebc02 columnFamilyName family1 2023-10-30 21:55:56,110 INFO [StoreOpener-38f4a1d5f9397e7a0d35170398eebc02-1] regionserver.HStore(310): Store=38f4a1d5f9397e7a0d35170398eebc02/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:56,110 INFO [StoreOpener-38f4a1d5f9397e7a0d35170398eebc02-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:55:56,111 DEBUG [StoreOpener-38f4a1d5f9397e7a0d35170398eebc02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2 2023-10-30 21:55:56,111 DEBUG [StoreOpener-38f4a1d5f9397e7a0d35170398eebc02-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2 2023-10-30 21:55:56,112 INFO [StoreOpener-38f4a1d5f9397e7a0d35170398eebc02-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38f4a1d5f9397e7a0d35170398eebc02 columnFamilyName family2 2023-10-30 21:55:56,112 INFO [StoreOpener-38f4a1d5f9397e7a0d35170398eebc02-1] regionserver.HStore(310): Store=38f4a1d5f9397e7a0d35170398eebc02/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-30 21:55:56,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:55:56,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:55:56,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-30 21:55:56,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:55:56,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-30 21:55:56,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 38f4a1d5f9397e7a0d35170398eebc02; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74530794, jitterRate=0.11059537529945374}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-30 21:55:56,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:55:56,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02., pid=122, masterSystemTime=1698702956017 2023-10-30 21:55:56,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:55:56,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:55:56,119 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=38f4a1d5f9397e7a0d35170398eebc02, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:56,119 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698702956119"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1698702956119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698702956119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698702956119"}]},"ts":"1698702956119"} 2023-10-30 21:55:56,121 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=118 2023-10-30 21:55:56,121 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 38f4a1d5f9397e7a0d35170398eebc02, server=jenkins-hbase4.apache.org,44371,1698702798019 in 254 msec 2023-10-30 21:55:56,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-30 21:55:56,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=38f4a1d5f9397e7a0d35170398eebc02, ASSIGN in 413 msec 2023-10-30 21:55:56,123 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-30 21:55:56,123 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698702956123"}]},"ts":"1698702956123"} 2023-10-30 21:55:56,124 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-10-30 21:55:56,126 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-10-30 21:55:56,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2570 sec 2023-10-30 21:55:56,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-30 21:55:56,977 INFO [Listener at localhost/36139] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-10-30 21:55:56,983 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:56,983 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:56,984 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:56,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:56,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 21:55:56,987 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 21:55:56,987 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:56,987 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 21:55:56,987 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 21:55:56,987 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:56,987 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:55:56,993 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:56,993 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:56,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:56,993 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:56,993 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:55:56,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:55:56,994 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 21:55:56,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 21:55:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 21:55:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 21:55:56,994 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:56,995 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. started... 2023-10-30 21:55:56,997 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 07ec08f87a490626e406acf5870c9440 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 21:55:56,997 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:56,997 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:56,998 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:56,998 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:55:56,998 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. started... 2023-10-30 21:55:56,998 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. started... 2023-10-30 21:55:56,998 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b644f44aa9cca8a1270c4b1b821da710 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 21:55:56,999 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 38f4a1d5f9397e7a0d35170398eebc02 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-30 21:55:57,064 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310303cddad4bc71a403baa3ed41aa7443734 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310303cddad4bc71a403baa3ed41aa7443734 2023-10-30 21:55:57,454 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310306eceea6aa8fe402f83547b01d3e3c13b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310306eceea6aa8fe402f83547b01d3e3c13b 2023-10-30 21:55:57,468 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030c7b49484d266490d8641e36dc2e99a4e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030c7b49484d266490d8641e36dc2e99a4e 2023-10-30 21:55:57,468 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/02a32f362bdb4d3ca6798bee6254ac75 2023-10-30 21:55:57,483 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/049b35e799874a5789f2d76af5df1ddb 2023-10-30 21:55:57,485 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/97401be213a949c4b7ffbb6ceeede585 2023-10-30 21:55:57,505 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103072c511de67164f7a88654d6ee12c0be6 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023103072c511de67164f7a88654d6ee12c0be6 2023-10-30 21:55:57,719 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-10-30 21:55:57,909 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/523cb4c059f84d89979f9097fce1c36d 2023-10-30 21:55:57,913 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/02a32f362bdb4d3ca6798bee6254ac75 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/02a32f362bdb4d3ca6798bee6254ac75 2023-10-30 21:55:57,925 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030828a7bc89de14f72bc96f259f6587059 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231030828a7bc89de14f72bc96f259f6587059 2023-10-30 21:55:57,930 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030562be96a2054436ba7e46810c7ac54bc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231030562be96a2054436ba7e46810c7ac54bc 2023-10-30 21:55:57,934 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/126ac08ae476456fb570cdb0670bf727 2023-10-30 21:55:57,938 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/97401be213a949c4b7ffbb6ceeede585 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/97401be213a949c4b7ffbb6ceeede585 2023-10-30 21:55:57,940 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/02a32f362bdb4d3ca6798bee6254ac75, entries=4, sequenceid=5, filesize=5.5 K 2023-10-30 21:55:57,941 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/523cb4c059f84d89979f9097fce1c36d as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/523cb4c059f84d89979f9097fce1c36d 2023-10-30 21:55:57,944 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/523cb4c059f84d89979f9097fce1c36d, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 21:55:57,945 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b644f44aa9cca8a1270c4b1b821da710 in 947ms, sequenceid=5, compaction requested=false 2023-10-30 21:55:57,945 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:55:57,945 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:57,946 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:57,961 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/97401be213a949c4b7ffbb6ceeede585, entries=4, sequenceid=5, filesize=5.5 K 2023-10-30 21:55:57,962 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/126ac08ae476456fb570cdb0670bf727 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/126ac08ae476456fb570cdb0670bf727 2023-10-30 21:55:57,965 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/126ac08ae476456fb570cdb0670bf727, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 21:55:57,966 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 38f4a1d5f9397e7a0d35170398eebc02 in 967ms, sequenceid=5, compaction requested=false 2023-10-30 21:55:57,966 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:55:57,966 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:55:57,966 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:55:58,330 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/c7471427c6744efcbb8109862077b1d2 2023-10-30 21:55:58,334 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/049b35e799874a5789f2d76af5df1ddb as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/049b35e799874a5789f2d76af5df1ddb 2023-10-30 21:55:58,367 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/049b35e799874a5789f2d76af5df1ddb, entries=4, sequenceid=5, filesize=5.5 K 2023-10-30 21:55:58,368 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/c7471427c6744efcbb8109862077b1d2 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c7471427c6744efcbb8109862077b1d2 2023-10-30 21:55:58,371 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c7471427c6744efcbb8109862077b1d2, entries=2, sequenceid=5, filesize=5.1 K 2023-10-30 21:55:58,372 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 07ec08f87a490626e406acf5870c9440 in 1375ms, sequenceid=5, compaction requested=false 2023-10-30 21:55:58,372 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:55:58,372 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:58,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:55:58,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:55:58,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 21:55:58,372 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 21:55:58,374 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:55:58,374 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:58,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:58,374 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:55:58,374 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:55:58,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:58,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:58,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:55:58,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:58,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 21:55:58,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6191743e[Count = 0] remaining members to acquire global barrier 2023-10-30 21:55:58,375 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 21:55:58,375 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:55:58,376 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:55:58,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:55:58,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:55:58,377 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 21:55:58,377 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 21:55:58,377 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:55:58,377 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,377 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:55:58,378 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 21:55:58,378 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:58,378 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,378 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 21:55:58,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:58,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:58,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:58,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:58,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:55:58,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:58,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:55:58,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:55:58,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 21:55:58,380 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 21:55:58,380 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:55:58,380 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:55:58,380 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 21:55:58,380 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:55:58,387 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:58,387 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:58,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:58,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:58,387 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:58,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:58,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:55:58,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:55:58,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:58,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:55:58,388 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:58,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:55:58,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:58,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:55:58,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:55:58,389 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:55:58,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:55:58,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,391 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,391 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:58,391 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:55:58,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:58,391 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:55:58,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 21:55:58,391 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:55:58,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:58,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 21:55:58,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:55:58,391 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:55:58,391 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,391 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:55:58,391 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:55:58,391 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:58,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:55:58,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:55:58,391 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 21:55:58,392 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:55:58,492 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:55:58,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:55:58,494 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:58,494 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:58,494 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:55:58,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:55:58,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 21:55:58,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 21:55:58,498 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 21:55:58,498 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:58,498 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 21:55:58,498 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 21:55:58,498 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:58,498 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:55:58,500 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,500 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:55:58,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:55:58,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:55:58,500 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:55:58,500 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:55:58,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:55:58,501 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:55:58,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:55:58,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:55:58,501 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 21:55:58,501 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 21:55:58,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 21:55:58,502 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 21:55:58,502 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:55:58,502 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 21:55:58,502 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:58,502 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. started... 2023-10-30 21:55:58,502 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:55:58,502 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:55:58,502 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 07ec08f87a490626e406acf5870c9440 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 21:55:58,502 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:58,502 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:55:58,502 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. started... 2023-10-30 21:55:58,502 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. started... 2023-10-30 21:55:58,502 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b644f44aa9cca8a1270c4b1b821da710 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 21:55:58,502 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 38f4a1d5f9397e7a0d35170398eebc02 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-30 21:55:58,555 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030fee24fde8e064f8997caa39387a102eb to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030fee24fde8e064f8997caa39387a102eb 2023-10-30 21:55:58,555 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030bd135551ba1a4d1885bc0a872284a243 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030bd135551ba1a4d1885bc0a872284a243 2023-10-30 21:55:58,949 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030cf943883e2a141d88479e4ec41bb85ed to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030cf943883e2a141d88479e4ec41bb85ed 2023-10-30 21:55:58,970 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/acf367fce7ec4ce7bf788d09ace535d8 2023-10-30 21:55:58,970 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/c52af687aaa047689f03ef50bae4fb69 2023-10-30 21:55:59,014 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030d740cadd31c2492fb57702cd4946d8ca to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231030d740cadd31c2492fb57702cd4946d8ca 2023-10-30 21:55:59,363 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/5b251ea88eae4018938665c6d8979ea0 2023-10-30 21:55:59,406 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030afd66831ab984e2f9636fe2dd922a2ab to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231030afd66831ab984e2f9636fe2dd922a2ab 2023-10-30 21:55:59,419 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/cda3b7e1ccfd44c2824369b4ba69c6c2 2023-10-30 21:55:59,422 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/acf367fce7ec4ce7bf788d09ace535d8 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/acf367fce7ec4ce7bf788d09ace535d8 2023-10-30 21:55:59,446 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/acf367fce7ec4ce7bf788d09ace535d8, entries=4, sequenceid=9, filesize=5.5 K 2023-10-30 21:55:59,446 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/cda3b7e1ccfd44c2824369b4ba69c6c2 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/cda3b7e1ccfd44c2824369b4ba69c6c2 2023-10-30 21:55:59,449 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/cda3b7e1ccfd44c2824369b4ba69c6c2, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 21:55:59,450 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b644f44aa9cca8a1270c4b1b821da710 in 948ms, sequenceid=9, compaction requested=false 2023-10-30 21:55:59,450 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:55:59,450 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:55:59,450 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:55:59,797 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030be64194c24064bc89814317953fdbfc7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231030be64194c24064bc89814317953fdbfc7 2023-10-30 21:55:59,810 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/cb5311cd082a45fa9445e7f98cf4692e 2023-10-30 21:55:59,814 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/c52af687aaa047689f03ef50bae4fb69 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/c52af687aaa047689f03ef50bae4fb69 2023-10-30 21:55:59,837 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/c52af687aaa047689f03ef50bae4fb69, entries=4, sequenceid=9, filesize=5.5 K 2023-10-30 21:55:59,838 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/cb5311cd082a45fa9445e7f98cf4692e as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/cb5311cd082a45fa9445e7f98cf4692e 2023-10-30 21:55:59,841 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/cb5311cd082a45fa9445e7f98cf4692e, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 21:55:59,841 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 07ec08f87a490626e406acf5870c9440 in 1339ms, sequenceid=9, compaction requested=false 2023-10-30 21:55:59,842 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:55:59,842 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:55:59,842 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:56:00,202 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/23ba04c8e88c4246b4da0eb9b2490965 2023-10-30 21:56:00,206 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/5b251ea88eae4018938665c6d8979ea0 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/5b251ea88eae4018938665c6d8979ea0 2023-10-30 21:56:00,232 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/5b251ea88eae4018938665c6d8979ea0, entries=4, sequenceid=9, filesize=5.5 K 2023-10-30 21:56:00,233 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/23ba04c8e88c4246b4da0eb9b2490965 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/23ba04c8e88c4246b4da0eb9b2490965 2023-10-30 21:56:00,236 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/23ba04c8e88c4246b4da0eb9b2490965, entries=2, sequenceid=9, filesize=5.1 K 2023-10-30 21:56:00,237 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 38f4a1d5f9397e7a0d35170398eebc02 in 1735ms, sequenceid=9, compaction requested=false 2023-10-30 21:56:00,237 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:56:00,237 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:00,237 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:56:00,237 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:56:00,237 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,237 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 21:56:00,237 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 21:56:00,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:00,239 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:00,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:00,239 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:56:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:00,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:00,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:00,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 21:56:00,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34473e72[Count = 0] remaining members to acquire global barrier 2023-10-30 21:56:00,240 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 21:56:00,240 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:00,243 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:00,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:00,243 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 21:56:00,243 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 21:56:00,243 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,243 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:56:00,243 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:56:00,245 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,245 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 21:56:00,245 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:56:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:00,245 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 21:56:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:00,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:00,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:00,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:00,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:00,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:56:00,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 21:56:00,247 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 21:56:00,247 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:56:00,247 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:56:00,247 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 21:56:00,247 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:56:00,249 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:00,249 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:00,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:00,249 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:56:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:00,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:56:00,249 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:56:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:00,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:00,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:00,250 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:00,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:00,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:00,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,252 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,252 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:56:00,252 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:00,252 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:00,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:56:00,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:56:00,252 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:56:00,252 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 21:56:00,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:56:00,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 21:56:00,252 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:56:00,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:56:00,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:56:00,253 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:00,253 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 21:56:00,253 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:56:00,253 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:00,253 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:00,353 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:56:00,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:56:00,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:56:00,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:56:00,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:56:00,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:56:00,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 21:56:00,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 21:56:00,359 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 21:56:00,359 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:56:00,359 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 21:56:00,359 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 21:56:00,360 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:00,360 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:00,363 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:56:00,363 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:56:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:56:00,363 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:00,363 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:56:00,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:00,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:56:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:00,364 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 21:56:00,364 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 21:56:00,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 21:56:00,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 21:56:00,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:56:00,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 21:56:00,364 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:00,364 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. started... 2023-10-30 21:56:00,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:56:00,364 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:56:00,364 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:00,364 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. started... 2023-10-30 21:56:00,364 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:00,364 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 07ec08f87a490626e406acf5870c9440 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 21:56:00,364 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 38f4a1d5f9397e7a0d35170398eebc02 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 21:56:00,364 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. started... 2023-10-30 21:56:00,365 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b644f44aa9cca8a1270c4b1b821da710 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-30 21:56:00,416 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030fb2fa69fd8bd40469a4d6654d4e1ccdc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030fb2fa69fd8bd40469a4d6654d4e1ccdc 2023-10-30 21:56:00,825 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103052ce78e8a2eb48028bf12393ff4ac7c8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103052ce78e8a2eb48028bf12393ff4ac7c8 2023-10-30 21:56:00,825 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030685848fd8a444aa799d5168f5d194ccf to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030685848fd8a444aa799d5168f5d194ccf 2023-10-30 21:56:00,830 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/e7ad0f9cf3d44fcd8bb5fa98561a81c7 2023-10-30 21:56:00,850 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/9b689c1c7bc6489e8a75dcd5c6c488d5 2023-10-30 21:56:01,246 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/0553286a6c3547bd81e928b1825ee647 2023-10-30 21:56:01,282 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310301ca0ad3e253d43f3a07c9fcb3db0e846 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310301ca0ad3e253d43f3a07c9fcb3db0e846 2023-10-30 21:56:01,291 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023103009a4354f8b4645e7a2c1c112143f7caf to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023103009a4354f8b4645e7a2c1c112143f7caf 2023-10-30 21:56:01,295 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/44516cd039de4edba7ead607de5041f7 2023-10-30 21:56:01,299 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/9b689c1c7bc6489e8a75dcd5c6c488d5 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/9b689c1c7bc6489e8a75dcd5c6c488d5 2023-10-30 21:56:01,330 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/9b689c1c7bc6489e8a75dcd5c6c488d5, entries=4, sequenceid=13, filesize=5.5 K 2023-10-30 21:56:01,331 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/44516cd039de4edba7ead607de5041f7 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/44516cd039de4edba7ead607de5041f7 2023-10-30 21:56:01,334 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/44516cd039de4edba7ead607de5041f7, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 21:56:01,335 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 07ec08f87a490626e406acf5870c9440 in 971ms, sequenceid=13, compaction requested=true 2023-10-30 21:56:01,335 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:56:01,335 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:01,335 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:56:01,559 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-30 21:56:01,687 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030c33f23cad21e4b33927a32a4e28fb159 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231030c33f23cad21e4b33927a32a4e28fb159 2023-10-30 21:56:01,688 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/6e82829dc9bf4eee87395e883e160286 2023-10-30 21:56:01,692 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/e7ad0f9cf3d44fcd8bb5fa98561a81c7 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/e7ad0f9cf3d44fcd8bb5fa98561a81c7 2023-10-30 21:56:01,718 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/e7ad0f9cf3d44fcd8bb5fa98561a81c7, entries=4, sequenceid=13, filesize=5.5 K 2023-10-30 21:56:01,719 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/6e82829dc9bf4eee87395e883e160286 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/6e82829dc9bf4eee87395e883e160286 2023-10-30 21:56:01,722 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/6e82829dc9bf4eee87395e883e160286, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 21:56:01,723 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 38f4a1d5f9397e7a0d35170398eebc02 in 1359ms, sequenceid=13, compaction requested=true 2023-10-30 21:56:01,723 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:56:01,723 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:01,723 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:56:02,092 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/bd8a698dfc0e4d248c1a33e4c91b854c 2023-10-30 21:56:02,096 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/0553286a6c3547bd81e928b1825ee647 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0553286a6c3547bd81e928b1825ee647 2023-10-30 21:56:02,119 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0553286a6c3547bd81e928b1825ee647, entries=4, sequenceid=13, filesize=5.5 K 2023-10-30 21:56:02,120 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/bd8a698dfc0e4d248c1a33e4c91b854c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/bd8a698dfc0e4d248c1a33e4c91b854c 2023-10-30 21:56:02,123 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/bd8a698dfc0e4d248c1a33e4c91b854c, entries=2, sequenceid=13, filesize=5.1 K 2023-10-30 21:56:02,124 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b644f44aa9cca8a1270c4b1b821da710 in 1759ms, sequenceid=13, compaction requested=true 2023-10-30 21:56:02,124 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:56:02,124 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:02,124 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:56:02,124 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:56:02,124 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,124 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 21:56:02,124 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 21:56:02,126 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:02,126 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:02,127 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:02,127 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:56:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:02,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:02,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:02,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:02,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 21:56:02,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@403c460e[Count = 0] remaining members to acquire global barrier 2023-10-30 21:56:02,128 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 21:56:02,128 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:02,129 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:02,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:02,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:02,130 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 21:56:02,130 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,130 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:56:02,130 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 21:56:02,130 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:56:02,131 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,131 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 21:56:02,131 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:56:02,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:02,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:02,131 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 21:56:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:02,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:56:02,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 21:56:02,133 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 21:56:02,134 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:56:02,134 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:56:02,134 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 21:56:02,134 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:56:02,135 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:02,135 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:02,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:02,135 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:56:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:02,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:02,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:56:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:56:02,136 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:02,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:02,137 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:02,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:02,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:02,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,139 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,139 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:56:02,139 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:02,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:56:02,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 21:56:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:56:02,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:56:02,140 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:56:02,140 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:02,139 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:56:02,140 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 21:56:02,140 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 21:56:02,140 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:02,140 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:56:02,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:56:02,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:56:02,140 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:02,140 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:02,240 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:56:02,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:56:02,242 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:56:02,242 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:56:02,242 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. with WAL disabled. Data may be lost in the event of a crash. 2023-10-30 21:56:02,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:56:02,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 21:56:02,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 21:56:02,246 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 21:56:02,246 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:56:02,246 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 21:56:02,246 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 21:56:02,247 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:02,247 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:02,252 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:56:02,252 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:56:02,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:56:02,252 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:02,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:02,252 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:56:02,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:02,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:56:02,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:02,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 21:56:02,253 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 21:56:02,253 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 21:56:02,253 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 21:56:02,253 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:56:02,253 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 21:56:02,254 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:02,254 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:56:02,254 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:56:02,254 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. started... 2023-10-30 21:56:02,254 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:02,254 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:02,254 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 07ec08f87a490626e406acf5870c9440 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 21:56:02,254 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. started... 2023-10-30 21:56:02,254 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. started... 2023-10-30 21:56:02,254 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 38f4a1d5f9397e7a0d35170398eebc02 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 21:56:02,254 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b644f44aa9cca8a1270c4b1b821da710 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-30 21:56:02,697 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030b7a6ee60b30040ea86e66caccbbb4097 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030b7a6ee60b30040ea86e66caccbbb4097 2023-10-30 21:56:02,697 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030ae8b9c0103d1447ba11f5e2a47180b4f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030ae8b9c0103d1447ba11f5e2a47180b4f 2023-10-30 21:56:02,709 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231030a5fbc6ad952b40a1b5aa2d6ba3753e47 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030a5fbc6ad952b40a1b5aa2d6ba3753e47 2023-10-30 21:56:03,112 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/7b52b3c806ae417d89f473b4b2182e68 2023-10-30 21:56:03,112 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/0df6137eea31460aa6d7e949b600443c 2023-10-30 21:56:03,132 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/f6fc8211d2974753860671dd8c4bbd8c 2023-10-30 21:56:03,551 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030110f05b39dc245709c035cbb1895e9e8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231030110f05b39dc245709c035cbb1895e9e8 2023-10-30 21:56:03,555 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310305fd7451324b8445a8aeced6f24ecb579 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310305fd7451324b8445a8aeced6f24ecb579 2023-10-30 21:56:03,556 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/844a168793d54ac7a0e80d02e8a722ed 2023-10-30 21:56:03,561 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/0df6137eea31460aa6d7e949b600443c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0df6137eea31460aa6d7e949b600443c 2023-10-30 21:56:03,566 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310303d34f38c46204ae8a20c390e07047011 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310303d34f38c46204ae8a20c390e07047011 2023-10-30 21:56:03,574 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/4fd2baa890dd4f7683cee2f3b08822ed 2023-10-30 21:56:03,578 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/f6fc8211d2974753860671dd8c4bbd8c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/f6fc8211d2974753860671dd8c4bbd8c 2023-10-30 21:56:03,597 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0df6137eea31460aa6d7e949b600443c, entries=4, sequenceid=17, filesize=5.5 K 2023-10-30 21:56:03,598 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/844a168793d54ac7a0e80d02e8a722ed as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/844a168793d54ac7a0e80d02e8a722ed 2023-10-30 21:56:03,602 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/844a168793d54ac7a0e80d02e8a722ed, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 21:56:03,603 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/f6fc8211d2974753860671dd8c4bbd8c, entries=4, sequenceid=17, filesize=5.5 K 2023-10-30 21:56:03,603 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b644f44aa9cca8a1270c4b1b821da710 in 1349ms, sequenceid=17, compaction requested=true 2023-10-30 21:56:03,603 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:56:03,603 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:03,603 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:56:03,603 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/4fd2baa890dd4f7683cee2f3b08822ed as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/4fd2baa890dd4f7683cee2f3b08822ed 2023-10-30 21:56:03,607 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/4fd2baa890dd4f7683cee2f3b08822ed, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 21:56:03,608 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 38f4a1d5f9397e7a0d35170398eebc02 in 1354ms, sequenceid=17, compaction requested=true 2023-10-30 21:56:03,608 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:56:03,608 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:03,608 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:56:03,961 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/c28690d7ec9947b9afd7f5af58b2c847 2023-10-30 21:56:03,965 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/7b52b3c806ae417d89f473b4b2182e68 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/7b52b3c806ae417d89f473b4b2182e68 2023-10-30 21:56:03,988 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/7b52b3c806ae417d89f473b4b2182e68, entries=4, sequenceid=17, filesize=5.5 K 2023-10-30 21:56:03,989 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/c28690d7ec9947b9afd7f5af58b2c847 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c28690d7ec9947b9afd7f5af58b2c847 2023-10-30 21:56:03,993 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c28690d7ec9947b9afd7f5af58b2c847, entries=2, sequenceid=17, filesize=5.1 K 2023-10-30 21:56:03,994 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 07ec08f87a490626e406acf5870c9440 in 1740ms, sequenceid=17, compaction requested=true 2023-10-30 21:56:03,994 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:56:03,994 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:03,994 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:56:03,994 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:56:03,994 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:03,994 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 21:56:03,994 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 21:56:03,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:03,996 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:03,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:03,996 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:56:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:03,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:03,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:03,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 21:56:03,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f485fba[Count = 0] remaining members to acquire global barrier 2023-10-30 21:56:03,997 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 21:56:03,997 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:03,999 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:03,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:03,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:03,999 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 21:56:03,999 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 21:56:03,999 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:56:03,999 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,000 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:56:04,001 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,001 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 21:56:04,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:04,001 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:56:04,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:04,001 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 21:56:04,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:04,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:04,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:04,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:56:04,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 21:56:04,003 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 21:56:04,003 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:56:04,004 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:56:04,004 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 21:56:04,004 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:56:04,005 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,005 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:04,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:04,005 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:56:04,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,005 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:04,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:56:04,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:56:04,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:04,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,007 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:04,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:04,009 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:56:04,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 21:56:04,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:56:04,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:56:04,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 21:56:04,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:56:04,009 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:56:04,110 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:56:04,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:56:04,120 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:56:04,128 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:56:04,137 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:56:04,138 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:56:04,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-10-30 21:56:04,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-30 21:56:04,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-30 21:56:04,239 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-30 21:56:04,239 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:56:04,239 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-30 21:56:04,239 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-30 21:56:04,239 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,239 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:04,246 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,246 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:56:04,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:56:04,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:56:04,246 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,246 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-30 21:56:04,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:04,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-30 21:56:04,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:04,247 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-30 21:56:04,248 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-30 21:56:04,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-30 21:56:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-30 21:56:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-30 21:56:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-30 21:56:04,248 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-30 21:56:04,248 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. started... 2023-10-30 21:56:04,248 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-30 21:56:04,248 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:04,248 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 07ec08f87a490626e406acf5870c9440 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 21:56:04,248 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:04,248 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. started... 2023-10-30 21:56:04,248 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. started... 2023-10-30 21:56:04,249 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing b644f44aa9cca8a1270c4b1b821da710 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 21:56:04,249 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 38f4a1d5f9397e7a0d35170398eebc02 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-30 21:56:04,286 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/50c6d25121744b47aeef4bcb0de4cc0a 2023-10-30 21:56:04,294 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/92567bc04eb043a1a9ee9d21c49c3f8e 2023-10-30 21:56:04,318 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50c6d25121744b47aeef4bcb0de4cc0a 2023-10-30 21:56:04,324 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92567bc04eb043a1a9ee9d21c49c3f8e 2023-10-30 21:56:04,336 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/8bddb9ad37cc4b2db9645e866c67c649 2023-10-30 21:56:04,340 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8bddb9ad37cc4b2db9645e866c67c649 2023-10-30 21:56:04,340 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/50c6d25121744b47aeef4bcb0de4cc0a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/50c6d25121744b47aeef4bcb0de4cc0a 2023-10-30 21:56:04,364 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50c6d25121744b47aeef4bcb0de4cc0a 2023-10-30 21:56:04,364 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/50c6d25121744b47aeef4bcb0de4cc0a, entries=3, sequenceid=23, filesize=5.2 K 2023-10-30 21:56:04,365 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/8bddb9ad37cc4b2db9645e866c67c649 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/8bddb9ad37cc4b2db9645e866c67c649 2023-10-30 21:56:04,368 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8bddb9ad37cc4b2db9645e866c67c649 2023-10-30 21:56:04,368 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/8bddb9ad37cc4b2db9645e866c67c649, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 21:56:04,368 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 07ec08f87a490626e406acf5870c9440 in 120ms, sequenceid=23, compaction requested=true 2023-10-30 21:56:04,369 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:56:04,369 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:04,369 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-30 21:56:04,696 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/8f4a6040973a4861abaeb34ec718e853 2023-10-30 21:56:04,729 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f4a6040973a4861abaeb34ec718e853 2023-10-30 21:56:04,740 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/da0d6696796b42579fd3323e2d4c1642 2023-10-30 21:56:04,742 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/143461aba6f845e49a343e0fc968e4d4 2023-10-30 21:56:04,744 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da0d6696796b42579fd3323e2d4c1642 2023-10-30 21:56:04,744 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/8f4a6040973a4861abaeb34ec718e853 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/8f4a6040973a4861abaeb34ec718e853 2023-10-30 21:56:04,746 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 143461aba6f845e49a343e0fc968e4d4 2023-10-30 21:56:04,746 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/92567bc04eb043a1a9ee9d21c49c3f8e as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/92567bc04eb043a1a9ee9d21c49c3f8e 2023-10-30 21:56:04,769 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f4a6040973a4861abaeb34ec718e853 2023-10-30 21:56:04,769 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/8f4a6040973a4861abaeb34ec718e853, entries=3, sequenceid=23, filesize=5.2 K 2023-10-30 21:56:04,770 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/da0d6696796b42579fd3323e2d4c1642 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/da0d6696796b42579fd3323e2d4c1642 2023-10-30 21:56:04,770 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92567bc04eb043a1a9ee9d21c49c3f8e 2023-10-30 21:56:04,771 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/92567bc04eb043a1a9ee9d21c49c3f8e, entries=3, sequenceid=23, filesize=5.2 K 2023-10-30 21:56:04,771 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/143461aba6f845e49a343e0fc968e4d4 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/143461aba6f845e49a343e0fc968e4d4 2023-10-30 21:56:04,774 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for da0d6696796b42579fd3323e2d4c1642 2023-10-30 21:56:04,774 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/da0d6696796b42579fd3323e2d4c1642, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 21:56:04,775 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 143461aba6f845e49a343e0fc968e4d4 2023-10-30 21:56:04,775 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 38f4a1d5f9397e7a0d35170398eebc02 in 526ms, sequenceid=23, compaction requested=true 2023-10-30 21:56:04,775 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/143461aba6f845e49a343e0fc968e4d4, entries=1, sequenceid=23, filesize=5.0 K 2023-10-30 21:56:04,775 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:56:04,775 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:04,775 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-30 21:56:04,775 INFO [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b644f44aa9cca8a1270c4b1b821da710 in 527ms, sequenceid=23, compaction requested=true 2023-10-30 21:56:04,775 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:56:04,775 DEBUG [rs(jenkins-hbase4.apache.org,44371,1698702798019)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:04,775 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-30 21:56:04,775 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-30 21:56:04,775 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,775 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-30 21:56:04,776 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-30 21:56:04,777 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,777 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:04,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:04,777 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:04,778 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-30 21:56:04,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:04,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:04,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44371,1698702798019' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-30 21:56:04,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4512fee9[Count = 0] remaining members to acquire global barrier 2023-10-30 21:56:04,779 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-30 21:56:04,779 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:04,780 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:04,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:04,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:04,780 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-30 21:56:04,780 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,780 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-30 21:56:04,780 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-30 21:56:04,780 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,44371,1698702798019' in zk 2023-10-30 21:56:04,781 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-30 21:56:04,781 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,781 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:56:04,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:04,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:04,781 DEBUG [member: 'jenkins-hbase4.apache.org,44371,1698702798019' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-30 21:56:04,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:04,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,44371,1698702798019': 2023-10-30 21:56:04,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44371,1698702798019' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-30 21:56:04,783 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-30 21:56:04,783 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-30 21:56:04,783 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-30 21:56:04,783 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-30 21:56:04,783 INFO [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-30 21:56:04,786 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,786 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-30 21:56:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-30 21:56:04,786 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:56:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,786 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-30 21:56:04,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:56:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:56:04,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-30 21:56:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,787 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-30 21:56:04,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-30 21:56:04,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,790 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-30 21:56:04,790 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,790 DEBUG [(jenkins-hbase4.apache.org,33927,1698702796803)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-30 21:56:04,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-30 21:56:04,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-30 21:56:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-30 21:56:04,790 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-30 21:56:04,790 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:04,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-30 21:56:04,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-30 21:56:04,791 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-30 21:56:04,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-30 21:56:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-30 21:56:04,791 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:04,791 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:04,791 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-30 21:56:04,791 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-30 21:56:04,791 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-30 21:56:04,791 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-30 21:56:04,891 DEBUG [Listener at localhost/36139] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-30 21:56:04,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33927] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-30 21:56:04,893 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:56:04,893 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 07ec08f87a490626e406acf5870c9440/family1 is initiating major compaction (all files) 2023-10-30 21:56:04,893 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:56:04,893 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:56:04,893 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 07ec08f87a490626e406acf5870c9440/family1 in testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:04,893 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/049b35e799874a5789f2d76af5df1ddb, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/c52af687aaa047689f03ef50bae4fb69, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/9b689c1c7bc6489e8a75dcd5c6c488d5, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/7b52b3c806ae417d89f473b4b2182e68, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/50c6d25121744b47aeef4bcb0de4cc0a] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp, totalSize=27.1 K 2023-10-30 21:56:04,894 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 049b35e799874a5789f2d76af5df1ddb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702956984 2023-10-30 21:56:04,894 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting c52af687aaa047689f03ef50bae4fb69, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702958494 2023-10-30 21:56:04,894 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 9b689c1c7bc6489e8a75dcd5c6c488d5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702960355 2023-10-30 21:56:04,895 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 7b52b3c806ae417d89f473b4b2182e68, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702962242 2023-10-30 21:56:04,895 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 50c6d25121744b47aeef4bcb0de4cc0a, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:56:04,904 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 07ec08f87a490626e406acf5870c9440#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:56:05,343 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030545f876f54ad4cc58ab83693b9f5d2cf_del 2023-10-30 21:56:05,343 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030545f876f54ad4cc58ab83693b9f5d2cf_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030545f876f54ad4cc58ab83693b9f5d2cf_del 2023-10-30 21:56:06,198 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c8920f1befb47fc9f49cf2a32b2b758 2023-10-30 21:56:06,199 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family1/4c8920f1befb47fc9f49cf2a32b2b758 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/4c8920f1befb47fc9f49cf2a32b2b758 2023-10-30 21:56:06,222 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4c8920f1befb47fc9f49cf2a32b2b758 2023-10-30 21:56:06,223 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 07ec08f87a490626e406acf5870c9440/family1 of 07ec08f87a490626e406acf5870c9440 into 4c8920f1befb47fc9f49cf2a32b2b758(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:56:06,224 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:56:06,224 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:56:06,224 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 07ec08f87a490626e406acf5870c9440/family2 is initiating major compaction (all files) 2023-10-30 21:56:06,224 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:56:06,224 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:56:06,225 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 07ec08f87a490626e406acf5870c9440/family2 in testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:06,225 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c7471427c6744efcbb8109862077b1d2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/cb5311cd082a45fa9445e7f98cf4692e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/44516cd039de4edba7ead607de5041f7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c28690d7ec9947b9afd7f5af58b2c847, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/8bddb9ad37cc4b2db9645e866c67c649] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp, totalSize=25.4 K 2023-10-30 21:56:06,225 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting c7471427c6744efcbb8109862077b1d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702956984 2023-10-30 21:56:06,226 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting cb5311cd082a45fa9445e7f98cf4692e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702958494 2023-10-30 21:56:06,226 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 44516cd039de4edba7ead607de5041f7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702960355 2023-10-30 21:56:06,227 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting c28690d7ec9947b9afd7f5af58b2c847, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702962242 2023-10-30 21:56:06,227 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 8bddb9ad37cc4b2db9645e866c67c649, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:56:06,246 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:56:06,246 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c4c3b09 to 127.0.0.1:56981 2023-10-30 21:56:06,246 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:56:06,253 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 07ec08f87a490626e406acf5870c9440#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:56:06,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/049b35e799874a5789f2d76af5df1ddb, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/c52af687aaa047689f03ef50bae4fb69, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/9b689c1c7bc6489e8a75dcd5c6c488d5, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/7b52b3c806ae417d89f473b4b2182e68, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/50c6d25121744b47aeef4bcb0de4cc0a] to archive 2023-10-30 21:56:06,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:06,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/049b35e799874a5789f2d76af5df1ddb to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/049b35e799874a5789f2d76af5df1ddb 2023-10-30 21:56:06,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/c52af687aaa047689f03ef50bae4fb69 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/c52af687aaa047689f03ef50bae4fb69 2023-10-30 21:56:06,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/9b689c1c7bc6489e8a75dcd5c6c488d5 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/9b689c1c7bc6489e8a75dcd5c6c488d5 2023-10-30 21:56:06,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/7b52b3c806ae417d89f473b4b2182e68 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/7b52b3c806ae417d89f473b4b2182e68 2023-10-30 21:56:06,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/50c6d25121744b47aeef4bcb0de4cc0a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/50c6d25121744b47aeef4bcb0de4cc0a 2023-10-30 21:56:06,661 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310307569cea148b24588b9ba2bb5d985021a_del 2023-10-30 21:56:06,661 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310307569cea148b24588b9ba2bb5d985021a_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310307569cea148b24588b9ba2bb5d985021a_del 2023-10-30 21:56:07,474 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2fc299694b34f1a889eaa572e3ecf98 2023-10-30 21:56:07,474 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/.tmp/family2/b2fc299694b34f1a889eaa572e3ecf98 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/b2fc299694b34f1a889eaa572e3ecf98 2023-10-30 21:56:07,477 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2fc299694b34f1a889eaa572e3ecf98 2023-10-30 21:56:07,478 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 07ec08f87a490626e406acf5870c9440/family2 of 07ec08f87a490626e406acf5870c9440 into b2fc299694b34f1a889eaa572e3ecf98(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:56:07,478 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:56:07,478 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:56:07,478 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): b644f44aa9cca8a1270c4b1b821da710/family1 is initiating major compaction (all files) 2023-10-30 21:56:07,479 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:56:07,479 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:56:07,480 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of b644f44aa9cca8a1270c4b1b821da710/family1 in testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:07,480 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/02a32f362bdb4d3ca6798bee6254ac75, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/acf367fce7ec4ce7bf788d09ace535d8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0553286a6c3547bd81e928b1825ee647, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0df6137eea31460aa6d7e949b600443c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/92567bc04eb043a1a9ee9d21c49c3f8e] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp, totalSize=27.1 K 2023-10-30 21:56:07,481 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 02a32f362bdb4d3ca6798bee6254ac75, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702956983 2023-10-30 21:56:07,481 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting acf367fce7ec4ce7bf788d09ace535d8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702958494 2023-10-30 21:56:07,482 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 0553286a6c3547bd81e928b1825ee647, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702960355 2023-10-30 21:56:07,482 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 0df6137eea31460aa6d7e949b600443c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702962242 2023-10-30 21:56:07,482 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 92567bc04eb043a1a9ee9d21c49c3f8e, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:56:07,491 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): b644f44aa9cca8a1270c4b1b821da710#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:56:07,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c7471427c6744efcbb8109862077b1d2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/cb5311cd082a45fa9445e7f98cf4692e, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/44516cd039de4edba7ead607de5041f7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c28690d7ec9947b9afd7f5af58b2c847, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/8bddb9ad37cc4b2db9645e866c67c649] to archive 2023-10-30 21:56:07,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:07,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c7471427c6744efcbb8109862077b1d2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c7471427c6744efcbb8109862077b1d2 2023-10-30 21:56:07,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/cb5311cd082a45fa9445e7f98cf4692e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/cb5311cd082a45fa9445e7f98cf4692e 2023-10-30 21:56:07,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/44516cd039de4edba7ead607de5041f7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/44516cd039de4edba7ead607de5041f7 2023-10-30 21:56:07,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c28690d7ec9947b9afd7f5af58b2c847 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/c28690d7ec9947b9afd7f5af58b2c847 2023-10-30 21:56:07,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/8bddb9ad37cc4b2db9645e866c67c649 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family2/8bddb9ad37cc4b2db9645e866c67c649 2023-10-30 21:56:07,530 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023103041c7e477ade645f59f9175310ef2f8f7_del 2023-10-30 21:56:07,530 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103041c7e477ade645f59f9175310ef2f8f7_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103041c7e477ade645f59f9175310ef2f8f7_del 2023-10-30 21:56:07,986 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for adc6b17fa9a342cfb460aece518c1307 2023-10-30 21:56:07,987 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family1/adc6b17fa9a342cfb460aece518c1307 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/adc6b17fa9a342cfb460aece518c1307 2023-10-30 21:56:08,009 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for adc6b17fa9a342cfb460aece518c1307 2023-10-30 21:56:08,010 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b644f44aa9cca8a1270c4b1b821da710/family1 of b644f44aa9cca8a1270c4b1b821da710 into adc6b17fa9a342cfb460aece518c1307(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-30 21:56:08,010 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:56:08,010 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:56:08,010 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): b644f44aa9cca8a1270c4b1b821da710/family2 is initiating major compaction (all files) 2023-10-30 21:56:08,010 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:56:08,010 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:56:08,011 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of b644f44aa9cca8a1270c4b1b821da710/family2 in testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:08,011 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/523cb4c059f84d89979f9097fce1c36d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/cda3b7e1ccfd44c2824369b4ba69c6c2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/bd8a698dfc0e4d248c1a33e4c91b854c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/844a168793d54ac7a0e80d02e8a722ed, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/143461aba6f845e49a343e0fc968e4d4] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp, totalSize=25.4 K 2023-10-30 21:56:08,011 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 523cb4c059f84d89979f9097fce1c36d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702956983 2023-10-30 21:56:08,012 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting cda3b7e1ccfd44c2824369b4ba69c6c2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702958494 2023-10-30 21:56:08,012 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting bd8a698dfc0e4d248c1a33e4c91b854c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702960355 2023-10-30 21:56:08,012 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 844a168793d54ac7a0e80d02e8a722ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702962242 2023-10-30 21:56:08,013 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 143461aba6f845e49a343e0fc968e4d4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:56:08,019 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): b644f44aa9cca8a1270c4b1b821da710#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:56:08,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/02a32f362bdb4d3ca6798bee6254ac75, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/acf367fce7ec4ce7bf788d09ace535d8, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0553286a6c3547bd81e928b1825ee647, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0df6137eea31460aa6d7e949b600443c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/92567bc04eb043a1a9ee9d21c49c3f8e] to archive 2023-10-30 21:56:08,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:08,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/02a32f362bdb4d3ca6798bee6254ac75 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/02a32f362bdb4d3ca6798bee6254ac75 2023-10-30 21:56:08,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/acf367fce7ec4ce7bf788d09ace535d8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/acf367fce7ec4ce7bf788d09ace535d8 2023-10-30 21:56:08,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0553286a6c3547bd81e928b1825ee647 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0553286a6c3547bd81e928b1825ee647 2023-10-30 21:56:08,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0df6137eea31460aa6d7e949b600443c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/0df6137eea31460aa6d7e949b600443c 2023-10-30 21:56:08,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/92567bc04eb043a1a9ee9d21c49c3f8e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/92567bc04eb043a1a9ee9d21c49c3f8e 2023-10-30 21:56:08,426 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231030c9735367667e4f77b130d340b54493fc_del 2023-10-30 21:56:08,427 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231030c9735367667e4f77b130d340b54493fc_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231030c9735367667e4f77b130d340b54493fc_del 2023-10-30 21:56:09,239 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c88be56d09a4fca83c4518a40b280ec 2023-10-30 21:56:09,240 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/.tmp/family2/7c88be56d09a4fca83c4518a40b280ec as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/7c88be56d09a4fca83c4518a40b280ec 2023-10-30 21:56:09,244 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c88be56d09a4fca83c4518a40b280ec 2023-10-30 21:56:09,245 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b644f44aa9cca8a1270c4b1b821da710/family2 of b644f44aa9cca8a1270c4b1b821da710 into 7c88be56d09a4fca83c4518a40b280ec(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:56:09,245 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:56:09,245 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:56:09,245 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 38f4a1d5f9397e7a0d35170398eebc02/family1 is initiating major compaction (all files) 2023-10-30 21:56:09,245 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:56:09,245 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:56:09,245 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 38f4a1d5f9397e7a0d35170398eebc02/family1 in testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:09,245 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/97401be213a949c4b7ffbb6ceeede585, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/5b251ea88eae4018938665c6d8979ea0, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/e7ad0f9cf3d44fcd8bb5fa98561a81c7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/f6fc8211d2974753860671dd8c4bbd8c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/8f4a6040973a4861abaeb34ec718e853] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp, totalSize=27.1 K 2023-10-30 21:56:09,246 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 97401be213a949c4b7ffbb6ceeede585, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702956983 2023-10-30 21:56:09,246 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 5b251ea88eae4018938665c6d8979ea0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702958494 2023-10-30 21:56:09,246 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting e7ad0f9cf3d44fcd8bb5fa98561a81c7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702960355 2023-10-30 21:56:09,247 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting f6fc8211d2974753860671dd8c4bbd8c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702962242 2023-10-30 21:56:09,247 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 8f4a6040973a4861abaeb34ec718e853, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:56:09,254 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 38f4a1d5f9397e7a0d35170398eebc02#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:56:09,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/523cb4c059f84d89979f9097fce1c36d, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/cda3b7e1ccfd44c2824369b4ba69c6c2, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/bd8a698dfc0e4d248c1a33e4c91b854c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/844a168793d54ac7a0e80d02e8a722ed, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/143461aba6f845e49a343e0fc968e4d4] to archive 2023-10-30 21:56:09,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:09,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/523cb4c059f84d89979f9097fce1c36d to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/523cb4c059f84d89979f9097fce1c36d 2023-10-30 21:56:09,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/cda3b7e1ccfd44c2824369b4ba69c6c2 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/cda3b7e1ccfd44c2824369b4ba69c6c2 2023-10-30 21:56:09,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/bd8a698dfc0e4d248c1a33e4c91b854c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/bd8a698dfc0e4d248c1a33e4c91b854c 2023-10-30 21:56:09,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/844a168793d54ac7a0e80d02e8a722ed to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/844a168793d54ac7a0e80d02e8a722ed 2023-10-30 21:56:09,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/143461aba6f845e49a343e0fc968e4d4 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family2/143461aba6f845e49a343e0fc968e4d4 2023-10-30 21:56:09,691 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310309c8d44f0d57e49c09febf220e59fc055_del 2023-10-30 21:56:09,691 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310309c8d44f0d57e49c09febf220e59fc055_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310309c8d44f0d57e49c09febf220e59fc055_del 2023-10-30 21:56:10,549 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bde323dc5de453480b438eefcbe56b1 2023-10-30 21:56:10,550 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family1/9bde323dc5de453480b438eefcbe56b1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/9bde323dc5de453480b438eefcbe56b1 2023-10-30 21:56:10,572 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bde323dc5de453480b438eefcbe56b1 2023-10-30 21:56:10,573 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 38f4a1d5f9397e7a0d35170398eebc02/family1 of 38f4a1d5f9397e7a0d35170398eebc02 into 9bde323dc5de453480b438eefcbe56b1(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:56:10,573 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:56:10,573 DEBUG [Listener at localhost/36139] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-30 21:56:10,574 DEBUG [Listener at localhost/36139] regionserver.HStore(1912): 38f4a1d5f9397e7a0d35170398eebc02/family2 is initiating major compaction (all files) 2023-10-30 21:56:10,574 INFO [Listener at localhost/36139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-30 21:56:10,574 INFO [Listener at localhost/36139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-30 21:56:10,574 INFO [Listener at localhost/36139] regionserver.HRegion(2259): Starting compaction of 38f4a1d5f9397e7a0d35170398eebc02/family2 in testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:10,574 INFO [Listener at localhost/36139] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/126ac08ae476456fb570cdb0670bf727, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/23ba04c8e88c4246b4da0eb9b2490965, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/6e82829dc9bf4eee87395e883e160286, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/4fd2baa890dd4f7683cee2f3b08822ed, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/da0d6696796b42579fd3323e2d4c1642] into tmpdir=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp, totalSize=25.4 K 2023-10-30 21:56:10,574 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 126ac08ae476456fb570cdb0670bf727, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698702956983 2023-10-30 21:56:10,575 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 23ba04c8e88c4246b4da0eb9b2490965, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698702958494 2023-10-30 21:56:10,575 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 6e82829dc9bf4eee87395e883e160286, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698702960355 2023-10-30 21:56:10,575 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting 4fd2baa890dd4f7683cee2f3b08822ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698702962242 2023-10-30 21:56:10,575 DEBUG [Listener at localhost/36139] compactions.Compactor(207): Compacting da0d6696796b42579fd3323e2d4c1642, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-30 21:56:10,583 INFO [Listener at localhost/36139] throttle.PressureAwareThroughputController(145): 38f4a1d5f9397e7a0d35170398eebc02#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-30 21:56:10,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/97401be213a949c4b7ffbb6ceeede585, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/5b251ea88eae4018938665c6d8979ea0, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/e7ad0f9cf3d44fcd8bb5fa98561a81c7, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/f6fc8211d2974753860671dd8c4bbd8c, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/8f4a6040973a4861abaeb34ec718e853] to archive 2023-10-30 21:56:10,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:10,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/97401be213a949c4b7ffbb6ceeede585 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/97401be213a949c4b7ffbb6ceeede585 2023-10-30 21:56:10,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/5b251ea88eae4018938665c6d8979ea0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/5b251ea88eae4018938665c6d8979ea0 2023-10-30 21:56:10,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/e7ad0f9cf3d44fcd8bb5fa98561a81c7 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/e7ad0f9cf3d44fcd8bb5fa98561a81c7 2023-10-30 21:56:10,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/f6fc8211d2974753860671dd8c4bbd8c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/f6fc8211d2974753860671dd8c4bbd8c 2023-10-30 21:56:10,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/8f4a6040973a4861abaeb34ec718e853 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/8f4a6040973a4861abaeb34ec718e853 2023-10-30 21:56:10,990 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023103023853ff48ac04da6a0b2950d393decc2_del 2023-10-30 21:56:10,990 INFO [Listener at localhost/36139] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023103023853ff48ac04da6a0b2950d393decc2_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023103023853ff48ac04da6a0b2950d393decc2_del 2023-10-30 21:56:11,803 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f79906ef702452a9a58c1a4549f11f2 2023-10-30 21:56:11,804 DEBUG [Listener at localhost/36139] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/.tmp/family2/2f79906ef702452a9a58c1a4549f11f2 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/2f79906ef702452a9a58c1a4549f11f2 2023-10-30 21:56:11,807 INFO [Listener at localhost/36139] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f79906ef702452a9a58c1a4549f11f2 2023-10-30 21:56:11,808 INFO [Listener at localhost/36139] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 38f4a1d5f9397e7a0d35170398eebc02/family2 of 38f4a1d5f9397e7a0d35170398eebc02 into 2f79906ef702452a9a58c1a4549f11f2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-30 21:56:11,808 DEBUG [Listener at localhost/36139] regionserver.HRegion(2289): Compaction status journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:56:11,811 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:56:11,814 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:56:11,817 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:56:11,818 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:56:11,823 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33927] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10"\xD1\x0A\xDCy\x8E\xEB\xBA\x17\xF0\xF9@\xF9:J\xA6"\x10\xF4\xC2KIyLCC\xBD\xED\xD5i\x1A\xA5\xA3\xE7*\x10\x8C(\x99\xFEM\x12~\xD1\xF2\xEC~*\x1C0\xE6\xFB2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-10-30 21:56:11,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-30 21:56:11,845 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-30 21:56:11,845 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:56:11,845 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698703571845 2023-10-30 21:56:11,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-30 21:56:11,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/126ac08ae476456fb570cdb0670bf727, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/23ba04c8e88c4246b4da0eb9b2490965, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/6e82829dc9bf4eee87395e883e160286, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/4fd2baa890dd4f7683cee2f3b08822ed, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/da0d6696796b42579fd3323e2d4c1642] to archive 2023-10-30 21:56:11,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:11,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/126ac08ae476456fb570cdb0670bf727 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/126ac08ae476456fb570cdb0670bf727 2023-10-30 21:56:11,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/23ba04c8e88c4246b4da0eb9b2490965 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/23ba04c8e88c4246b4da0eb9b2490965 2023-10-30 21:56:11,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/6e82829dc9bf4eee87395e883e160286 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/6e82829dc9bf4eee87395e883e160286 2023-10-30 21:56:11,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/4fd2baa890dd4f7683cee2f3b08822ed to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/4fd2baa890dd4f7683cee2f3b08822ed 2023-10-30 21:56:11,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/da0d6696796b42579fd3323e2d4c1642 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family2/da0d6696796b42579fd3323e2d4c1642 2023-10-30 21:56:12,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-10-30 21:56:12,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023103041c7e477ade645f59f9175310ef2f8f7_del 2023-10-30 21:56:12,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310309c8d44f0d57e49c09febf220e59fc055_del 2023-10-30 21:56:12,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231030545f876f54ad4cc58ab83693b9f5d2cf_del 2023-10-30 21:56:12,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 21:56:12,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] zookeeper.ReadOnlyZKClient(139): Connect 0x63d03897 to 127.0.0.1:56981 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-30 21:56:12,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5849f2fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-30 21:56:12,222 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 21:56:12,770 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231030cd8e03292af3425db51fb05d29973fbc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030cd8e03292af3425db51fb05d29973fbc 2023-10-30 21:56:12,771 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 21:56:12,782 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-30 21:56:12,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-30 21:56:12,792 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-30 21:56:12,793 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-30 21:56:12,819 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/5cac2e4758124584a0dcf2bdbd353029 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-30 21:56:12,819 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/5cac2e4758124584a0dcf2bdbd353029}] 2023-10-30 21:56:12,824 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/5cac2e4758124584a0dcf2bdbd353029 for inclusion in 07ec08f87a490626e406acf5870c9440/family1 2023-10-30 21:56:12,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-30 21:56:12,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-30 21:56:12,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:56:12,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030/family1/5cac2e4758124584a0dcf2bdbd353029 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__7gme2c2ks62q6iusp3t17hglqff63kk2454nic179qo8cvudi2gfs23879d90ghj/family1/5cac2e4758124584a0dcf2bdbd353029 2023-10-30 21:56:12,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__7gme2c2ks62q6iusp3t17hglqff63kk2454nic179qo8cvudi2gfs23879d90ghj/family1/5cac2e4758124584a0dcf2bdbd353029 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/6563afbd6ad6441db4da2c71d1b5b0a3_SeqId_28_ 2023-10-30 21:56:12,848 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__7gme2c2ks62q6iusp3t17hglqff63kk2454nic179qo8cvudi2gfs23879d90ghj/family1/5cac2e4758124584a0dcf2bdbd353029 into 07ec08f87a490626e406acf5870c9440/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/6563afbd6ad6441db4da2c71d1b5b0a3_SeqId_28_ - updating store file list. 2023-10-30 21:56:12,870 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/6563afbd6ad6441db4da2c71d1b5b0a3_SeqId_28_ into 07ec08f87a490626e406acf5870c9440/family1 2023-10-30 21:56:12,870 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__7gme2c2ks62q6iusp3t17hglqff63kk2454nic179qo8cvudi2gfs23879d90ghj/family1/5cac2e4758124584a0dcf2bdbd353029 into 07ec08f87a490626e406acf5870c9440/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/family1/6563afbd6ad6441db4da2c71d1b5b0a3_SeqId_28_) 2023-10-30 21:56:12,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__7gme2c2ks62q6iusp3t17hglqff63kk2454nic179qo8cvudi2gfs23879d90ghj/family1/5cac2e4758124584a0dcf2bdbd353029 2023-10-30 21:56:12,872 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 21:56:12,873 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:12,874 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030685848fd8a444aa799d5168f5d194ccf to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030685848fd8a444aa799d5168f5d194ccf 2023-10-30 21:56:12,875 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030ae8b9c0103d1447ba11f5e2a47180b4f to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030ae8b9c0103d1447ba11f5e2a47180b4f 2023-10-30 21:56:12,876 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030bd135551ba1a4d1885bc0a872284a243 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030bd135551ba1a4d1885bc0a872284a243 2023-10-30 21:56:12,877 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030c7b49484d266490d8641e36dc2e99a4e to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030c7b49484d266490d8641e36dc2e99a4e 2023-10-30 21:56:12,877 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-30 21:56:12,877 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231030' 2023-10-30 21:56:12,877 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 21:56:12,877 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 21:56:13,420 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023103057f2420bb61342059a5115c6a8be0a06 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103057f2420bb61342059a5115c6a8be0a06 2023-10-30 21:56:13,420 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 21:56:13,462 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/5bfcccc9d65b4feb93fadb507f488c4c first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-30 21:56:13,463 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/5bfcccc9d65b4feb93fadb507f488c4c}] 2023-10-30 21:56:13,464 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/5bfcccc9d65b4feb93fadb507f488c4c for inclusion in b644f44aa9cca8a1270c4b1b821da710/family1 2023-10-30 21:56:13,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-30 21:56:13,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first= last=1 2023-10-30 21:56:13,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:56:13,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030/family1/5bfcccc9d65b4feb93fadb507f488c4c to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__r0cshokhbk7otg1i2hbshaishgobcqlguorhla0eebpjfgl9h1junlcie4v1ovnc/family1/5bfcccc9d65b4feb93fadb507f488c4c 2023-10-30 21:56:13,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__r0cshokhbk7otg1i2hbshaishgobcqlguorhla0eebpjfgl9h1junlcie4v1ovnc/family1/5bfcccc9d65b4feb93fadb507f488c4c as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/2015108fbc0945eca5e0a4434279fb92_SeqId_28_ 2023-10-30 21:56:13,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__r0cshokhbk7otg1i2hbshaishgobcqlguorhla0eebpjfgl9h1junlcie4v1ovnc/family1/5bfcccc9d65b4feb93fadb507f488c4c into b644f44aa9cca8a1270c4b1b821da710/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/2015108fbc0945eca5e0a4434279fb92_SeqId_28_ - updating store file list. 2023-10-30 21:56:13,509 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/2015108fbc0945eca5e0a4434279fb92_SeqId_28_ into b644f44aa9cca8a1270c4b1b821da710/family1 2023-10-30 21:56:13,509 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__r0cshokhbk7otg1i2hbshaishgobcqlguorhla0eebpjfgl9h1junlcie4v1ovnc/family1/5bfcccc9d65b4feb93fadb507f488c4c into b644f44aa9cca8a1270c4b1b821da710/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/family1/2015108fbc0945eca5e0a4434279fb92_SeqId_28_) 2023-10-30 21:56:13,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__r0cshokhbk7otg1i2hbshaishgobcqlguorhla0eebpjfgl9h1junlcie4v1ovnc/family1/5bfcccc9d65b4feb93fadb507f488c4c 2023-10-30 21:56:13,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 21:56:13,511 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:13,513 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103052ce78e8a2eb48028bf12393ff4ac7c8 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103052ce78e8a2eb48028bf12393ff4ac7c8 2023-10-30 21:56:13,513 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310306eceea6aa8fe402f83547b01d3e3c13b to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310306eceea6aa8fe402f83547b01d3e3c13b 2023-10-30 21:56:13,514 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030b7a6ee60b30040ea86e66caccbbb4097 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030b7a6ee60b30040ea86e66caccbbb4097 2023-10-30 21:56:13,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030fee24fde8e064f8997caa39387a102eb to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231030fee24fde8e064f8997caa39387a102eb 2023-10-30 21:56:13,515 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-30 21:56:13,515 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231030' 2023-10-30 21:56:13,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 21:56:13,516 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 21:56:14,490 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310307067314652b144819abe733ae508a0c0 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310307067314652b144819abe733ae508a0c0 2023-10-30 21:56:14,491 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 21:56:14,533 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/c05167e9980a4b668646730bdaf6b22a first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-30 21:56:14,534 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02., hostname=jenkins-hbase4.apache.org,44371,1698702798019, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/c05167e9980a4b668646730bdaf6b22a}] 2023-10-30 21:56:14,536 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(763): Validating hfile at hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/c05167e9980a4b668646730bdaf6b22a for inclusion in 38f4a1d5f9397e7a0d35170398eebc02/family1 2023-10-30 21:56:14,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-30 21:56:14,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-30 21:56:14,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegion(2446): Flush status journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:56:14,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030/family1/c05167e9980a4b668646730bdaf6b22a to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__guddc1svebr4ke80i7fkjmnob87dnrp4u81e6vnl67f9l15r0kmdkgjrierdj0d1/family1/c05167e9980a4b668646730bdaf6b22a 2023-10-30 21:56:14,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__guddc1svebr4ke80i7fkjmnob87dnrp4u81e6vnl67f9l15r0kmdkgjrierdj0d1/family1/c05167e9980a4b668646730bdaf6b22a as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/c0b5c7f22bb4412ab6044df161e6fd9d_SeqId_28_ 2023-10-30 21:56:14,561 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(849): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__guddc1svebr4ke80i7fkjmnob87dnrp4u81e6vnl67f9l15r0kmdkgjrierdj0d1/family1/c05167e9980a4b668646730bdaf6b22a into 38f4a1d5f9397e7a0d35170398eebc02/family1 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/c0b5c7f22bb4412ab6044df161e6fd9d_SeqId_28_ - updating store file list. 2023-10-30 21:56:14,582 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(882): Loaded HFile hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/c0b5c7f22bb4412ab6044df161e6fd9d_SeqId_28_ into 38f4a1d5f9397e7a0d35170398eebc02/family1 2023-10-30 21:56:14,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.HStore(855): Successfully loaded hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__guddc1svebr4ke80i7fkjmnob87dnrp4u81e6vnl67f9l15r0kmdkgjrierdj0d1/family1/c05167e9980a4b668646730bdaf6b22a into 38f4a1d5f9397e7a0d35170398eebc02/family1 (new location: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/family1/c0b5c7f22bb4412ab6044df161e6fd9d_SeqId_28_) 2023-10-30 21:56:14,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44371] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/staging/jenkins__testMajorCompactionFromAdmin__guddc1svebr4ke80i7fkjmnob87dnrp4u81e6vnl67f9l15r0kmdkgjrierdj0d1/family1/c05167e9980a4b668646730bdaf6b22a 2023-10-30 21:56:14,585 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231030 table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 21:56:14,585 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:14,586 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310303cddad4bc71a403baa3ed41aa7443734 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310303cddad4bc71a403baa3ed41aa7443734 2023-10-30 21:56:14,587 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030a5fbc6ad952b40a1b5aa2d6ba3753e47 to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030a5fbc6ad952b40a1b5aa2d6ba3753e47 2023-10-30 21:56:14,588 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030cf943883e2a141d88479e4ec41bb85ed to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030cf943883e2a141d88479e4ec41bb85ed 2023-10-30 21:56:14,589 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030fb2fa69fd8bd40469a4d6654d4e1ccdc to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231030fb2fa69fd8bd40469a4d6654d4e1ccdc 2023-10-30 21:56:14,589 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-30 21:56:14,589 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231030' 2023-10-30 21:56:14,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231030 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 21:56:14,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-30 21:56:14,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-30 21:56:14,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103041c7e477ade645f59f9175310ef2f8f7_del] 2023-10-30 21:56:14,590 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:14,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103041c7e477ade645f59f9175310ef2f8f7_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023103041c7e477ade645f59f9175310ef2f8f7_del 2023-10-30 21:56:14,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-30 21:56:14,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310309c8d44f0d57e49c09febf220e59fc055_del] 2023-10-30 21:56:14,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:14,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310309c8d44f0d57e49c09febf220e59fc055_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310309c8d44f0d57e49c09febf220e59fc055_del 2023-10-30 21:56:14,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-30 21:56:14,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030545f876f54ad4cc58ab83693b9f5d2cf_del] 2023-10-30 21:56:14,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] backup.HFileArchiver(360): Archiving compacted files. 2023-10-30 21:56:14,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030545f876f54ad4cc58ab83693b9f5d2cf_del to hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231030545f876f54ad4cc58ab83693b9f5d2cf_del 2023-10-30 21:56:14,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-30 21:56:14,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1698702802222] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-30 21:56:14,596 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-30 21:56:14,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.7530 sec 2023-10-30 21:56:14,614 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:56:14,616 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:56:14,618 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-30 21:56:14,619 DEBUG [Listener at localhost/36139] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-30 21:56:14,622 INFO [Listener at localhost/36139] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-30 21:56:14,657 INFO [Listener at localhost/36139] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 259), OpenFileDescriptor=640 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 237), ProcessCount=167 (was 167), AvailableMemoryMB=15175 (was 15181) 2023-10-30 21:56:14,657 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x576037b1 to 127.0.0.1:56981 2023-10-30 21:56:14,658 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:56:14,658 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-30 21:56:14,658 INFO [Listener at localhost/36139] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-30 21:56:14,658 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x224c80d2 to 127.0.0.1:56981 2023-10-30 21:56:14,658 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:56:14,658 DEBUG [Listener at localhost/36139] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-30 21:56:14,658 DEBUG [Listener at localhost/36139] util.JVMClusterUtil(257): Found active master hash=1333066448, stopped=false 2023-10-30 21:56:14,658 INFO [Listener at localhost/36139] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33927,1698702796803 2023-10-30 21:56:14,660 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-30 21:56:14,660 INFO [Listener at localhost/36139] procedure2.ProcedureExecutor(628): Stopping 2023-10-30 21:56:14,660 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-30 21:56:14,660 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 21:56:14,661 DEBUG [Listener at localhost/36139] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16dfcc52 to 127.0.0.1:56981 2023-10-30 21:56:14,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 21:56:14,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-30 21:56:14,661 DEBUG [Listener at localhost/36139] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:56:14,661 INFO [Listener at localhost/36139] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44371,1698702798019' ***** 2023-10-30 21:56:14,661 INFO [Listener at localhost/36139] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-30 21:56:14,661 INFO [RS:0;jenkins-hbase4:44371] regionserver.HeapMemoryManager(220): Stopping 2023-10-30 21:56:14,662 INFO [RS:0;jenkins-hbase4:44371] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-30 21:56:14,662 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-30 21:56:14,662 INFO [RS:0;jenkins-hbase4:44371] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-30 21:56:14,662 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 751af663fb4a94faedac2cbca910218e 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 29b75b5a035966f9b7d1aa40c20581da 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 267d79cc122426879ba4819ed95e4172 2023-10-30 21:56:14,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 751af663fb4a94faedac2cbca910218e, disabling compactions & flushes 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 1463c308949ad0d3c4d75470c2b83c3f 2023-10-30 21:56:14,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 89ebfe6836789cb4975f6008a3b09078 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 13107aa05a22fec95264a0367afc4530 2023-10-30 21:56:14,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 80f2ea819d0876ea7ac6b96623c135ef 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for c3a28ebc198b1a1c5b23a42f79c57432 2023-10-30 21:56:14,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. after waiting 0 ms 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 566e29064d55be1b9902bdf189115faf 2023-10-30 21:56:14,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 059490245c09fc93a3f34853d7b38366 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for f370aafa6070d611274135fa479ee59f 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 07ec08f87a490626e406acf5870c9440 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 9d593f9a29a626d8061e5169c6a744da 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for b644f44aa9cca8a1270c4b1b821da710 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for d2596744999eb35a27ef7cc00864b0b8 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 8be07748de4150840684d857f190524e 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 80663ddf3580f76f31d5f9b2bc6708de 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 38f4a1d5f9397e7a0d35170398eebc02 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 5cafb98da3f570bc35e5e8c528f7fba0 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:56:14,663 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:14,663 DEBUG [RS:0;jenkins-hbase4:44371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29978007 to 127.0.0.1:56981 2023-10-30 21:56:14,663 DEBUG [RS:0;jenkins-hbase4:44371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:56:14,664 INFO [RS:0;jenkins-hbase4:44371] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-30 21:56:14,664 INFO [RS:0;jenkins-hbase4:44371] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-30 21:56:14,664 INFO [RS:0;jenkins-hbase4:44371] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-30 21:56:14,664 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-30 21:56:14,664 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-10-30 21:56:14,664 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-30 21:56:14,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-30 21:56:14,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-30 21:56:14,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-30 21:56:14,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-30 21:56:14,665 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-10-30 21:56:14,665 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1504): Waiting on 059490245c09fc93a3f34853d7b38366, 07ec08f87a490626e406acf5870c9440, 13107aa05a22fec95264a0367afc4530, 1463c308949ad0d3c4d75470c2b83c3f, 1588230740, 267d79cc122426879ba4819ed95e4172, 29b75b5a035966f9b7d1aa40c20581da, 38f4a1d5f9397e7a0d35170398eebc02, 566e29064d55be1b9902bdf189115faf, 5cafb98da3f570bc35e5e8c528f7fba0, 751af663fb4a94faedac2cbca910218e, 80663ddf3580f76f31d5f9b2bc6708de, 80f2ea819d0876ea7ac6b96623c135ef, 862e3599e897d4e8a6ef63901b9c259f, 89ebfe6836789cb4975f6008a3b09078, 8be07748de4150840684d857f190524e, 9d593f9a29a626d8061e5169c6a744da, b644f44aa9cca8a1270c4b1b821da710, c3a28ebc198b1a1c5b23a42f79c57432, d2596744999eb35a27ef7cc00864b0b8, f370aafa6070d611274135fa479ee59f 2023-10-30 21:56:14,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/751af663fb4a94faedac2cbca910218e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-30 21:56:14,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:56:14,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 751af663fb4a94faedac2cbca910218e: 2023-10-30 21:56:14,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1698702842941.751af663fb4a94faedac2cbca910218e. 2023-10-30 21:56:14,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 29b75b5a035966f9b7d1aa40c20581da, disabling compactions & flushes 2023-10-30 21:56:14,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:56:14,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:56:14,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. after waiting 0 ms 2023-10-30 21:56:14,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:56:14,669 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-30 21:56:14,669 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-30 21:56:14,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/29b75b5a035966f9b7d1aa40c20581da/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-30 21:56:14,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:56:14,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 29b75b5a035966f9b7d1aa40c20581da: 2023-10-30 21:56:14,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698702802373.29b75b5a035966f9b7d1aa40c20581da. 2023-10-30 21:56:14,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 267d79cc122426879ba4819ed95e4172, disabling compactions & flushes 2023-10-30 21:56:14,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:56:14,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:56:14,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. after waiting 0 ms 2023-10-30 21:56:14,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:56:14,678 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/.tmp/info/bc1745b2cb1c436788c365d3769f8c5f 2023-10-30 21:56:14,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/267d79cc122426879ba4819ed95e4172/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-30 21:56:14,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:56:14,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 267d79cc122426879ba4819ed95e4172: 2023-10-30 21:56:14,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1698702842941.267d79cc122426879ba4819ed95e4172. 2023-10-30 21:56:14,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1463c308949ad0d3c4d75470c2b83c3f, disabling compactions & flushes 2023-10-30 21:56:14,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:56:14,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:56:14,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. after waiting 0 ms 2023-10-30 21:56:14,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:56:14,682 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc1745b2cb1c436788c365d3769f8c5f 2023-10-30 21:56:14,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/1463c308949ad0d3c4d75470c2b83c3f/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-30 21:56:14,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:56:14,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1463c308949ad0d3c4d75470c2b83c3f: 2023-10-30 21:56:14,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1698702898452.1463c308949ad0d3c4d75470c2b83c3f. 2023-10-30 21:56:14,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 89ebfe6836789cb4975f6008a3b09078, disabling compactions & flushes 2023-10-30 21:56:14,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:56:14,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:56:14,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. after waiting 0 ms 2023-10-30 21:56:14,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:56:14,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/.tmp/rep_barrier/cf6dc7e998f04926885fe6e3412e4974 2023-10-30 21:56:14,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/89ebfe6836789cb4975f6008a3b09078/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 21:56:14,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:56:14,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 89ebfe6836789cb4975f6008a3b09078: 2023-10-30 21:56:14,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1698702924198.89ebfe6836789cb4975f6008a3b09078. 2023-10-30 21:56:14,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 13107aa05a22fec95264a0367afc4530, disabling compactions & flushes 2023-10-30 21:56:14,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:56:14,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:56:14,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. after waiting 0 ms 2023-10-30 21:56:14,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:56:14,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf6dc7e998f04926885fe6e3412e4974 2023-10-30 21:56:14,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testScannerOnBulkLoadRefHFiles/13107aa05a22fec95264a0367afc4530/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-30 21:56:14,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:56:14,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 13107aa05a22fec95264a0367afc4530: 2023-10-30 21:56:14,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1698702842941.13107aa05a22fec95264a0367afc4530. 2023-10-30 21:56:14,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80f2ea819d0876ea7ac6b96623c135ef, disabling compactions & flushes 2023-10-30 21:56:14,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:56:14,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:56:14,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. after waiting 0 ms 2023-10-30 21:56:14,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:56:14,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/80f2ea819d0876ea7ac6b96623c135ef/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 21:56:14,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:56:14,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80f2ea819d0876ea7ac6b96623c135ef: 2023-10-30 21:56:14,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1698702924198.80f2ea819d0876ea7ac6b96623c135ef. 2023-10-30 21:56:14,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3a28ebc198b1a1c5b23a42f79c57432, disabling compactions & flushes 2023-10-30 21:56:14,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:56:14,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:56:14,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. after waiting 0 ms 2023-10-30 21:56:14,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:56:14,701 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-10-30 21:56:14,701 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/.tmp/table/16ba149a2f574a98a086ef92aa172a79 2023-10-30 21:56:14,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyPolicy/c3a28ebc198b1a1c5b23a42f79c57432/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 21:56:14,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:56:14,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3a28ebc198b1a1c5b23a42f79c57432: 2023-10-30 21:56:14,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1698702846943.c3a28ebc198b1a1c5b23a42f79c57432. 2023-10-30 21:56:14,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 566e29064d55be1b9902bdf189115faf, disabling compactions & flushes 2023-10-30 21:56:14,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:56:14,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:56:14,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. after waiting 0 ms 2023-10-30 21:56:14,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:56:14,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 16ba149a2f574a98a086ef92aa172a79 2023-10-30 21:56:14,709 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/.tmp/info/bc1745b2cb1c436788c365d3769f8c5f as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/info/bc1745b2cb1c436788c365d3769f8c5f 2023-10-30 21:56:14,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/566e29064d55be1b9902bdf189115faf/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-30 21:56:14,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:56:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 566e29064d55be1b9902bdf189115faf: 2023-10-30 21:56:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698702875292.566e29064d55be1b9902bdf189115faf. 2023-10-30 21:56:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 059490245c09fc93a3f34853d7b38366, disabling compactions & flushes 2023-10-30 21:56:14,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:56:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:56:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. after waiting 0 ms 2023-10-30 21:56:14,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:56:14,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc1745b2cb1c436788c365d3769f8c5f 2023-10-30 21:56:14,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/info/bc1745b2cb1c436788c365d3769f8c5f, entries=226, sequenceid=130, filesize=37.9 K 2023-10-30 21:56:14,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/.tmp/rep_barrier/cf6dc7e998f04926885fe6e3412e4974 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/rep_barrier/cf6dc7e998f04926885fe6e3412e4974 2023-10-30 21:56:14,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithMonthlyPolicy/059490245c09fc93a3f34853d7b38366/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-30 21:56:14,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:56:14,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 059490245c09fc93a3f34853d7b38366: 2023-10-30 21:56:14,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1698702942173.059490245c09fc93a3f34853d7b38366. 2023-10-30 21:56:14,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f370aafa6070d611274135fa479ee59f, disabling compactions & flushes 2023-10-30 21:56:14,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:56:14,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:56:14,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. after waiting 0 ms 2023-10-30 21:56:14,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:56:14,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf6dc7e998f04926885fe6e3412e4974 2023-10-30 21:56:14,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/rep_barrier/cf6dc7e998f04926885fe6e3412e4974, entries=1, sequenceid=130, filesize=5.0 K 2023-10-30 21:56:14,721 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/.tmp/table/16ba149a2f574a98a086ef92aa172a79 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/table/16ba149a2f574a98a086ef92aa172a79 2023-10-30 21:56:14,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/ns/testMinorCompaction/f370aafa6070d611274135fa479ee59f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 21:56:14,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:56:14,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f370aafa6070d611274135fa479ee59f: 2023-10-30 21:56:14,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1698702924198.f370aafa6070d611274135fa479ee59f. 2023-10-30 21:56:14,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 07ec08f87a490626e406acf5870c9440, disabling compactions & flushes 2023-10-30 21:56:14,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:14,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:14,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. after waiting 0 ms 2023-10-30 21:56:14,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:14,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/07ec08f87a490626e406acf5870c9440/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 21:56:14,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:14,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 07ec08f87a490626e406acf5870c9440: 2023-10-30 21:56:14,726 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 16ba149a2f574a98a086ef92aa172a79 2023-10-30 21:56:14,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1698702954838.07ec08f87a490626e406acf5870c9440. 2023-10-30 21:56:14,726 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/table/16ba149a2f574a98a086ef92aa172a79, entries=27, sequenceid=130, filesize=6.6 K 2023-10-30 21:56:14,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9d593f9a29a626d8061e5169c6a744da, disabling compactions & flushes 2023-10-30 21:56:14,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:56:14,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:56:14,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. after waiting 0 ms 2023-10-30 21:56:14,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:56:14,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 62ms, sequenceid=130, compaction requested=false 2023-10-30 21:56:14,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithMonthlyPolicy/9d593f9a29a626d8061e5169c6a744da/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-30 21:56:14,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:56:14,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9d593f9a29a626d8061e5169c6a744da: 2023-10-30 21:56:14,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1698702815826.9d593f9a29a626d8061e5169c6a744da. 2023-10-30 21:56:14,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b644f44aa9cca8a1270c4b1b821da710, disabling compactions & flushes 2023-10-30 21:56:14,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:14,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:14,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. after waiting 0 ms 2023-10-30 21:56:14,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:14,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-10-30 21:56:14,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-30 21:56:14,732 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-30 21:56:14,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-30 21:56:14,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-30 21:56:14,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/b644f44aa9cca8a1270c4b1b821da710/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 21:56:14,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:14,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b644f44aa9cca8a1270c4b1b821da710: 2023-10-30 21:56:14,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1698702954838.b644f44aa9cca8a1270c4b1b821da710. 2023-10-30 21:56:14,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d2596744999eb35a27ef7cc00864b0b8, disabling compactions & flushes 2023-10-30 21:56:14,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:56:14,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:56:14,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. after waiting 0 ms 2023-10-30 21:56:14,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:56:14,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/d2596744999eb35a27ef7cc00864b0b8/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-30 21:56:14,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:56:14,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d2596744999eb35a27ef7cc00864b0b8: 2023-10-30 21:56:14,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1698702898452.d2596744999eb35a27ef7cc00864b0b8. 2023-10-30 21:56:14,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8be07748de4150840684d857f190524e, disabling compactions & flushes 2023-10-30 21:56:14,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:56:14,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:56:14,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. after waiting 0 ms 2023-10-30 21:56:14,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:56:14,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMinorCompactionWithWeeklyPolicy/8be07748de4150840684d857f190524e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-30 21:56:14,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:56:14,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8be07748de4150840684d857f190524e: 2023-10-30 21:56:14,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1698702829074.8be07748de4150840684d857f190524e. 2023-10-30 21:56:14,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80663ddf3580f76f31d5f9b2bc6708de, disabling compactions & flushes 2023-10-30 21:56:14,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:56:14,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:56:14,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. after waiting 0 ms 2023-10-30 21:56:14,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:56:14,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/80663ddf3580f76f31d5f9b2bc6708de/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-30 21:56:14,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:56:14,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80663ddf3580f76f31d5f9b2bc6708de: 2023-10-30 21:56:14,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698702860191.80663ddf3580f76f31d5f9b2bc6708de. 2023-10-30 21:56:14,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 38f4a1d5f9397e7a0d35170398eebc02, disabling compactions & flushes 2023-10-30 21:56:14,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:14,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:14,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. after waiting 0 ms 2023-10-30 21:56:14,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testMajorCompactionFromAdmin/38f4a1d5f9397e7a0d35170398eebc02/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-30 21:56:14,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 38f4a1d5f9397e7a0d35170398eebc02: 2023-10-30 21:56:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1698702954838.38f4a1d5f9397e7a0d35170398eebc02. 2023-10-30 21:56:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5cafb98da3f570bc35e5e8c528f7fba0, disabling compactions & flushes 2023-10-30 21:56:14,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:56:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:56:14,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. after waiting 0 ms 2023-10-30 21:56:14,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:56:14,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5cafb98da3f570bc35e5e8c528f7fba0 1/1 column families, dataSize=109 B heapSize=592 B 2023-10-30 21:56:14,760 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-30 21:56:14,865 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1504): Waiting on 5cafb98da3f570bc35e5e8c528f7fba0, 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:56:15,066 DEBUG [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1504): Waiting on 5cafb98da3f570bc35e5e8c528f7fba0, 862e3599e897d4e8a6ef63901b9c259f 2023-10-30 21:56:15,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0/.tmp/info/70990f1ea28643d2b48b734a902ce428 2023-10-30 21:56:15,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0/.tmp/info/70990f1ea28643d2b48b734a902ce428 as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0/info/70990f1ea28643d2b48b734a902ce428 2023-10-30 21:56:15,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0/info/70990f1ea28643d2b48b734a902ce428, entries=3, sequenceid=7, filesize=4.8 K 2023-10-30 21:56:15,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 5cafb98da3f570bc35e5e8c528f7fba0 in 414ms, sequenceid=7, compaction requested=false 2023-10-30 21:56:15,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/hbase/namespace/5cafb98da3f570bc35e5e8c528f7fba0/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-10-30 21:56:15,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:56:15,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5cafb98da3f570bc35e5e8c528f7fba0: 2023-10-30 21:56:15,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1698702801605.5cafb98da3f570bc35e5e8c528f7fba0. 2023-10-30 21:56:15,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 862e3599e897d4e8a6ef63901b9c259f, disabling compactions & flushes 2023-10-30 21:56:15,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:56:15,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:56:15,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. after waiting 0 ms 2023-10-30 21:56:15,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:56:15,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/data/default/testCompactionWithHFileLink/862e3599e897d4e8a6ef63901b9c259f/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-30 21:56:15,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:56:15,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 862e3599e897d4e8a6ef63901b9c259f: 2023-10-30 21:56:15,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1698702898452.862e3599e897d4e8a6ef63901b9c259f. 2023-10-30 21:56:15,266 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44371,1698702798019; all regions closed. 2023-10-30 21:56:15,273 DEBUG [RS:0;jenkins-hbase4:44371] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/oldWALs 2023-10-30 21:56:15,273 INFO [RS:0;jenkins-hbase4:44371] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44371%2C1698702798019.meta:.meta(num 1698702801357) 2023-10-30 21:56:15,277 DEBUG [RS:0;jenkins-hbase4:44371] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/oldWALs 2023-10-30 21:56:15,277 INFO [RS:0;jenkins-hbase4:44371] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44371%2C1698702798019:(num 1698702800832) 2023-10-30 21:56:15,277 DEBUG [RS:0;jenkins-hbase4:44371] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:56:15,277 INFO [RS:0;jenkins-hbase4:44371] regionserver.LeaseManager(133): Closed leases 2023-10-30 21:56:15,278 INFO [RS:0;jenkins-hbase4:44371] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-30 21:56:15,278 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-30 21:56:15,279 INFO [RS:0;jenkins-hbase4:44371] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44371 2023-10-30 21:56:15,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44371,1698702798019 2023-10-30 21:56:15,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-30 21:56:15,287 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-30 21:56:15,288 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44371,1698702798019] 2023-10-30 21:56:15,288 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44371,1698702798019; numProcessing=1 2023-10-30 21:56:15,290 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44371,1698702798019 already deleted, retry=false 2023-10-30 21:56:15,290 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,44371,1698702798019 expired; onlineServers=0 2023-10-30 21:56:15,290 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33927,1698702796803' ***** 2023-10-30 21:56:15,290 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-30 21:56:15,290 DEBUG [M:0;jenkins-hbase4:33927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e49f0eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-30 21:56:15,290 INFO [M:0;jenkins-hbase4:33927] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33927,1698702796803 2023-10-30 21:56:15,290 INFO [M:0;jenkins-hbase4:33927] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33927,1698702796803; all regions closed. 2023-10-30 21:56:15,290 DEBUG [M:0;jenkins-hbase4:33927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-30 21:56:15,290 DEBUG [M:0;jenkins-hbase4:33927] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-30 21:56:15,290 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-30 21:56:15,290 DEBUG [M:0;jenkins-hbase4:33927] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-30 21:56:15,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1698702800488] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1698702800488,5,FailOnTimeoutGroup] 2023-10-30 21:56:15,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1698702800488] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1698702800488,5,FailOnTimeoutGroup] 2023-10-30 21:56:15,291 INFO [M:0;jenkins-hbase4:33927] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-30 21:56:15,291 INFO [M:0;jenkins-hbase4:33927] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-30 21:56:15,291 INFO [M:0;jenkins-hbase4:33927] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-30 21:56:15,291 DEBUG [M:0;jenkins-hbase4:33927] master.HMaster(1512): Stopping service threads 2023-10-30 21:56:15,291 INFO [M:0;jenkins-hbase4:33927] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-30 21:56:15,291 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-30 21:56:15,292 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-30 21:56:15,292 ERROR [M:0;jenkins-hbase4:33927] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-10-30 21:56:15,292 INFO [M:0;jenkins-hbase4:33927] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-30 21:56:15,292 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-30 21:56:15,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-30 21:56:15,293 DEBUG [M:0;jenkins-hbase4:33927] zookeeper.ZKUtil(398): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-30 21:56:15,293 WARN [M:0;jenkins-hbase4:33927] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-30 21:56:15,293 INFO [M:0;jenkins-hbase4:33927] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-30 21:56:15,293 INFO [M:0;jenkins-hbase4:33927] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-30 21:56:15,293 DEBUG [M:0;jenkins-hbase4:33927] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-30 21:56:15,293 INFO [M:0;jenkins-hbase4:33927] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 21:56:15,293 DEBUG [M:0;jenkins-hbase4:33927] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 21:56:15,294 DEBUG [M:0;jenkins-hbase4:33927] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-30 21:56:15,294 DEBUG [M:0;jenkins-hbase4:33927] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 21:56:15,294 INFO [M:0;jenkins-hbase4:33927] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.51 KB heapSize=598.13 KB 2023-10-30 21:56:15,388 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 21:56:15,388 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): regionserver:44371-0x1019952dc2b0001, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 21:56:15,388 INFO [RS:0;jenkins-hbase4:44371] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44371,1698702798019; zookeeper connection closed. 2023-10-30 21:56:15,389 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2514cbcd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2514cbcd 2023-10-30 21:56:15,389 INFO [Listener at localhost/36139] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-10-30 21:56:15,701 INFO [M:0;jenkins-hbase4:33927] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.51 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/809dc566954443bc9a11fc495b3a7cba 2023-10-30 21:56:15,705 INFO [M:0;jenkins-hbase4:33927] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 809dc566954443bc9a11fc495b3a7cba 2023-10-30 21:56:15,706 DEBUG [M:0;jenkins-hbase4:33927] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/809dc566954443bc9a11fc495b3a7cba as hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/809dc566954443bc9a11fc495b3a7cba 2023-10-30 21:56:15,709 INFO [M:0;jenkins-hbase4:33927] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 809dc566954443bc9a11fc495b3a7cba 2023-10-30 21:56:15,709 INFO [M:0;jenkins-hbase4:33927] regionserver.HStore(1080): Added hdfs://localhost:42305/user/jenkins/test-data/af1b42f8-ffbe-eabe-80e8-5cdcf2706d44/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/809dc566954443bc9a11fc495b3a7cba, entries=123, sequenceid=1005, filesize=33.3 K 2023-10-30 21:56:15,710 INFO [M:0;jenkins-hbase4:33927] regionserver.HRegion(2948): Finished flush of dataSize ~512.51 KB/524808, heapSize ~598.12 KB/612472, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 416ms, sequenceid=1005, compaction requested=false 2023-10-30 21:56:15,711 INFO [M:0;jenkins-hbase4:33927] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-30 21:56:15,711 DEBUG [M:0;jenkins-hbase4:33927] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-30 21:56:15,713 INFO [M:0;jenkins-hbase4:33927] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-30 21:56:15,713 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-30 21:56:15,714 INFO [M:0;jenkins-hbase4:33927] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33927 2023-10-30 21:56:15,717 DEBUG [M:0;jenkins-hbase4:33927] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33927,1698702796803 already deleted, retry=false 2023-10-30 21:56:15,818 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 21:56:15,818 INFO [M:0;jenkins-hbase4:33927] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33927,1698702796803; zookeeper connection closed. 2023-10-30 21:56:15,818 DEBUG [Listener at localhost/36139-EventThread] zookeeper.ZKWatcher(600): master:33927-0x1019952dc2b0000, quorum=127.0.0.1:56981, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-30 21:56:15,820 WARN [Listener at localhost/36139] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-30 21:56:15,824 INFO [Listener at localhost/36139] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-30 21:56:15,932 WARN [BP-602744979-172.31.14.131-1698702793341 heartbeating to localhost/127.0.0.1:42305] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-30 21:56:15,933 WARN [BP-602744979-172.31.14.131-1698702793341 heartbeating to localhost/127.0.0.1:42305] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-602744979-172.31.14.131-1698702793341 (Datanode Uuid ac4e3709-2f37-4845-b3a9-02be2e5644e6) service to localhost/127.0.0.1:42305 2023-10-30 21:56:15,936 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/cluster_28bfcc88-fd43-a1ce-833d-58e2af823f6c/dfs/data/data1/current/BP-602744979-172.31.14.131-1698702793341] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-30 21:56:15,936 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/53a56e63-8798-fca7-1767-fe4549129d40/cluster_28bfcc88-fd43-a1ce-833d-58e2af823f6c/dfs/data/data2/current/BP-602744979-172.31.14.131-1698702793341] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-30 21:56:15,963 INFO [Listener at localhost/36139] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-30 21:56:16,097 INFO [Listener at localhost/36139] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-30 21:56:16,190 INFO [Listener at localhost/36139] hbase.HBaseTestingUtility(1293): Minicluster is down